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Preface 


The present volume of The Pocket Mathematical Library 
continues the study of infinite series begun in its companion 
volume Infinite Series: Rudiments, by the same author. Together 
the two volumes give a detailed treatment of the theory of nu- 
merical series, i.e., infinite series whose terms are numbers. The 
picture is then completed by a third volume, entitled Functional 
Series, which, as its name implies, is devoted to the study of 
infinite series whose terms are functions. The set of three vol- 
umes makes up a comprehensive treatise on all aspects of a key 
topic of pure and applied mathematics. 

As in the companion volume, the problems appearing at the 
end of each section constitute an important part of the course, 
and should not be neglected by the serious student. 
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CHAPTER 1 


Operations on Series 


1. Associativity of Convergent Series 


The concept of the sum of an infinite series differs substan- 
tially from the concept of the sum of a finite number of terms 
(considered in arithmetic and algebra) in that it involves taking 
a limit. In certain cases, properties of ordinary sums carry over to 
sums of infinite series, but usually only under certain conditions 
to be determined below. In other cases, the ordinary properties 
of finite series break down in a striking fashion. Thus, in general, 
we must be very careful when attempting to extend properties of 
finite sums to the case of infinite series. 

Our first result along these lines expresses the associativity of 
convergent series, analogous to the similar property of finite 
sums: 

THEOREM |. Let 


a + a, boe +a, ee (1) 
be a convergent series, and let* 
à Là; b = (a, xa) 
(aio bas) (a uico bas) cn 
q) 


1. Here {n,} is some subsequence of the sequence of positive integers 1, 
2,... such that ny < n3 «€ *'. 
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be a new series obtained from (1) by amalgamating the terms of (1) 
in arbitrary groups without changing the order of appearance of 


the terms. Then (1) is convergent, with the same sum as (1). 
Proof. The sequence of partial sums 


A,—d, d, o Fd, 


(a, + + + an) + (asit +n) to 
+ (Gn, icons + as) (k = 1,2,...) 
of the new Series (1) is just the subsequence 

Anis EP Åna 
of the sequence of partial sums 
A, — 04:5 +4, (n = 1,2, ...) 


of the original series (1). But obviously every subsequence of a 
convergent sequence with limit A (say) is also convergent with 
limit A. JP 

Unlike the case of finite sums, the associativity of convergent 
series breaks down if we try to apply the property in reverse 
order, so to speak. More exactly, suppose we start from a con- 


vergent series of the form (1). Then the new series (1) obtained 


by dropping parentheses in (1) may well turn out to be diver- 
gent. For example, the two series 


aqd-bpv+d-Y+d-)N4+--=04+04+0--=0 (2 
and 

1-ü0-D-(1-1)---21-0-0----1 (3) 
both converge, but the series 


1I-I41—-141—14-- 


2. The symbol [ff stands for Q.E.D. and indicates the end of a proof. 
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obtained by dropping parentheses in either (2) or (3) obviously 
diverges. However, Theorem | has the following qualified con- 
verse: 

THEOREM 2. Giren a convergent series(1), suppose the series (1) 
obtained by dropping parentheses in (1) is convergent. Then its sum 
is the same as the sum of the original series (1). 

Proof. An obvious consequence of Theorem 1. Bl 

Under certain conditions, convergence of (1) does in fact 
guarantee that of (1): 

THEOREM 3. Suppose the numbers inside each set of parentheses 
in the series (i) ull have the same sign, where this sign may vary 
from one set of parentheses to the next, and suppose (1) is conver- 
gent. Then the series (1) obtained by dropping parentheses in (i) is 
also convergent. 

Proof. In this case, the partial sum A, either increases or de- 
creases as n increases from n,. , to ng. Therefore 


An, X An X An, OF An 2 An Z AS, 
where n = n4, ..., Ag. Equivalently, 
A, € A,& Á, or A,-, > Án 2 Åp, (4) 


for the same values of n. But A, > A as k > œ, where A is the 


sum of (1) and hence, by (4), 4, 5 A4asn— œ. BM 
Example. Prove the convergence of the series 


a ae 
ice 2 


where [x] is the integral part of x, 1.e., the largest integer <x. 
Solution. Grouping together terms of identical sign in (5), we 


z l 
Y (-1)} do l1 pop l 2 
kat k? k? +1 (k+ 1} - 1 


=) CD*'e. (6) 


(5) 
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But k terms 
———————— 
2 1 1 1 
<— + +o + ———_ 
2k+1 k k+l k? +k-l 
k+1 terms 
1 1 2 
+ + — <=, 
k? +k (k+1?-1 k 


since each of the first k terms lies in the interval 





while each of the last k + 1 terms lies in the interval 


—1l1 exs—l . 
(k + 1)? k? +k 


Therefore {c,} is a decreasing sequence with limit zero. It follows 
from Leibniz's test (Ruds., p. 73)? that (6) converges. But then 
(5) also converges, by Theorem 3. 


PROBLEM 
Prove that if 
l l 
=] — — — — — ; 
p 2s 35 4s 
2-14 La Lal 
2s 35 4s ? 


then 





p=(I- sar) (0) 


ifs > 1. Prove that (7) leads to an absurdity if0 < s < 1. Why? 


3. The abbreviation Ruds. refers to the volume Infinite Series: Rudiments 
by G.M.Fichtenholz (The Pocket Mathematical Library). 


Operations on Series 5 
2. Commutativity of Absolutely Convergent Series 


Let 
4,+ a+: ta, (1) 


be a convergent series, and let 
ai + a; + + ak Tem ln, + da, ocn + Qn, Lee (1^) 


be a new series obtained from (1) by rearranging its terms in any 
way whatsoever.* We then ask whether the series (1^) converges, 
and if so, whether it has the same sum as the original series (1). 
There is now a sharp distinction between the case of absolutely 
convergent series and that of conditionally convergent series. In 
fact, absolutely convergent series, as opposed to conditionally 
convergent series (see Sec. 3), are commutative in the sense of the 
following 

THEOREM. Given an absolutely convergent series (1), the series 
(1^) obtained by arbitrarily rearranging the terms of (1) is conver- 
gent, with the same sum as (1). 

Proof. First suppose the series (1) is positive. Given any posi- 
tive integer k, let N be the largest of the integers n,, n2, ..., Ny. 
Then, obviously, 

Ay X An, 


where Ay is the Mth partial sum of (1) and Aj the Ath partial sum 
of (1^). Hence, a fortiori, 
A, <A, 
where A is the sum of (1). It follows that (1’) is convergent 
(why?), with sum A’ satisfying the inequality 
A' « A. (2) 
4. Thus [7] is a sequence made up of all the positive integers 1, 2, ... 


(without omissions or duplications), but no longer arranged in increasing 
order. 
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On the other hand, the series (1) can also be regarded as a re- 
arrangement of the terms of (1), and hence 


A « A', (3) 
by exactly the same argument. Comparing (2) and (3), we get 
A =A, 


Now suppose (1) is an arbitrary series, whose terms can have 
values of either sign. The series 


[^9] 
2. la, = lail + lag] +--+ + dal tos (4) 
n=1 


converges, since (1) is absolutely convergent, and moreover, any 
rearrangement of (4) also converges, since (4) is a positive series. 
Therefore (1’) is also absolutely convergent, with sum A’. But 
the sum A of the absolutely convergent series (1) can be written 
in the form 

A=P-Q, 


where P and Q are the sums of the positive series 


» Py (5) 
j= 


and 
» di; (6) 


formed from the positive terms p, , P2, ... of (1) and the absolute 
values 91, q2, ... of the negative terms (Ruds., p. 64).5 Rearrang- 
ing the terms of (1) induces corresponding rearrangements of the 
terms of (5) and (6), but as shown in the first part of the proof, 
this has no effect on the sums P and Q of these series. It follows 


that 
A-P-Q-A. W 


5. The terms of (5) and (6) are arranged in the sarne order as they (or 
their negatives) appear in (1). 
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PROBLEMS 


1. Prove that the factors of an absolutely convergent infinite 
product (Ruds., p.97) can be rearranged arbitrarily without 
affecting either the convergence or the value of the product. How 
does this apply to the product 





(Ruds.. p. 132)? 


2. Verify the expansion 


Prove that the factors on the right cannot be arbitrarily re- 
arranged. 
Hint. The series 


7 7t 2z 27 nz nz 


is conditionally convergent, and hence its terms cannot be 
arbitrarily rearranged (see Sec. 3). 


3. Verify the expansion 


. T x E 
sinx =x II 1— > e[l] + X je xm 
n-1 n7 n7t 


Prove that the factors on the right can be arbitrarily rearranged. 
Hint. The infinite product is now absolutely convergent (why?) 


3. Riemann's Theorem 


Next we show that a conditionally convergent series does not 
have the commutative property, and in fact can be made to have 


a different sum or even to diverge by suitably rearranging its 
terms. 
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LEMMA. Let 


a +4, +e Fdo (1) 
be a conditionally convergent series, let 

Pit Pot + ppt (2) 
be the series formed from the positive terms of (1), and let 

qi +ga tie ta to (3) 


be the series formed from the absolute values of the negative terms 
of (1).8 Then the series (2) and (3) both diverge. 

Proof. Let the series (1), (2) and (3) have partial sums A,, P, 
and Q,, respectively. Then 


A, = P,— Qr (4) 
and 
AT = P, + Qr, (5) 


where A; is the nth partial sum of the series 
lai] + laal + ++ + lanl ns (5*) 


and j is the number of positive terms and k the number of nega- 
tive terms in the first n terms of (1). If one of the series (2) and (3) 
converges, then so does the other, because of (4). But then the 
series (5*) converges, because of (5), i.e., (1) is absolutely con- 
vergent, contrary to hypothesis. This contradiction shows that 
(2) and (3) both diverge. W 

Remark. Despite the fact that (2) and (3) both diverge, we have 


lim p, = lim q, = 0, (6) 


joo ko 


6. Footnote 5 also applies here. 
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since (1) converges (conditionally) and hence 


lim a, = 0. 


now 


We can now prove the following remarkable 

THEOREM (Riemann’s theorem). 7f the series (1) is conditionally 
convergent, then, given any number B (finite or equal to + oc), the 
terms of (1) can be rearranged to give a new series whose sums 
equals B. 

Proof. First suppose B is finite. Since the series (2) and (3) 
both diverge, the same is true of all their remainders (Ruds., 
Theorem 1, p. 6). Hence, starting from any position in the series 
(2) and (3). we can choose enough terms to make the sum exceed 
any given number. Using this fact, we now arrange the terms of 
the series (1) as follows. First we choose enough positive terms 
of (1), in their order of appearance in the series. to have a sum 
greater than B: 


Pi + Pato + py, B. 


We then write down enough negative terms (again in their order 
of appearance in the series) to make the resulting sum /ess 
than B: 


Prt pater + Py -— U1 -— 92-7 — qu, < B. 


Next we add more positive terms (from those that remain) to 
have 


Prt + Py G1 — 0 ak + Paar t7 + py, > B. 


Then we choose enough negative terms (from those that remain) 
to have 


Prt + pi 4 77 A, 


+ Pisi + Pi 7 Fea 7o 7 dis € B, 
1 Fichtenholz (2094) 
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and so on. Obviously, every term in the original series will 
eventually appear in the new series if this process is Continued 
indefinitely. 

Now suppose that every time we write down groups of positive 
and negative terms, we see to it that no more terms are added 
than needed to make the sum greater than or less than B, as the 
case may be. Then the deviation of this sum from B (on one side 
or the other) can never have an absolute value greater than the 
last term written down. Therefore it follows from (6) that the 
new series 


(Pi toe + Pay) (i to + I) to 
+ (Parasi tot + Pa) + Gig ga too + de) cte (7) 


is convergent, with sum B. Hence, by Theorem 3, p. 3, the sum 
of (7) after dropping parentheses is still B. 

Finally suppose B = +00. Choosing an increasing sequence 
of numbers B,, B;,... approaching infinity, we first select enough 
positive terms to exceed B,, afterwards adding one negative 
term, then select enough positive terms to exceed B2, afterwards 
adding another negative term, and so on. This obviously gives a 
series with sum + oo. Similarly, we can find a rearrangement of 
the series (1) with sum — œ. B 

Remark. Riemann's theorem makes it clear that conditional 
convergence of a series comes about only because of mutual 
cancellation of positive and negative terms, and hence depends in 
an essential way on the order of appearance of the terms. On the 
other hand, absolute convergence of a series comes about 
because of the rate at which the terms grow small, and does not 
depend on the order in which the terms appear. 

Example. Consider the conditionally convergent series 


1 
+e ————-——e.e 


1-4441 
3 4 2k — 1 2k 


I 
— + 
2 
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with sum In 2 (Ruds., p. 117). Rearranging the terms in such a 
way that two negative terms follow each positive term, we get 


N 
aj= 
UJ 
a 
oo 





—— - -— 9 
*2k-1 4k-2 4k ©) 


As we now show, the effect of this rearrangement is to make the 
sum of (8) one half as small. In fact, denoting the partial sums 
of (8) and (9) by A, and An, respectively, we have 


m l l l 
Abn -———-—— 
3 X —1 4k-2 x) 








II 
* 
ima 
[TN 
A 
A 
| — 
NO 

| 
> — 
=| 
eee 





ll 
Nie 
iM as 
- 
Lum 
N 
a 
| — 
= 

| 
g|- 
NLA 

II 
mj- 

N 

3 


and hence A3, —^ 41n 2. But 





+ i l i i 1 
Agm-1 = Aam + am A3m-2 = Aam-1 + ám 2 
approach the same limit 41n 2. Therefore the series (10) is con- 
vergent, with sum 4 In 2. 


PROBLEMS 


1. Given a conditionally convergent series and any two num- 
bers B and C > B, prove that the terms of (1) can be rearranged 
in such a way that the partial sums of the series have B as 
their smallest limit point (lower limit) and C as their largest 
limit point (upper limit). 

2. Starting from the formula 

1 


H,=1+—-4+-4+-inntcty, 
2 n 
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for the nth partial sum of the harmonic series (Ruds., p. 18), 
where C is Euler's constant and y, — 0 as n — oo, prove that 














p tetms g terms 
^ e—a 
l 1 1 1 
l] + — ter + ——— — — +e 
3 2p — 1 2 2q 
p terms 
—— oo 
1 1 
+ Tec 
2p +1 4p—] 
qa terms 
——————— 
MEE laesae. 
2g +2 4q q 


where the series on the left is a rearrangement of the condition- 
ally convergent series (8). In particular, verify that (8) and (9) 


have the sums In 2 and l In 2, as in the above example, and 
show that 2 





Is this kind of rearrangement sufficiently general to give a series 
with any preassigned sum whatsoever? 
Hint. Note that 
1 1 l l 
2 4 2n 2 
1 





Operations on Series 13 
4. Multiplication of Series 


We have already considered term-by-term addition (or sub- 
traction) of two convergent series, as well as multiplication of 
a convergent series by a constant (Ruds., p. 7). We now consider 
multiplication of two convergent series 


A= PV Gm = Gy + a, + + d, + (1) 

m=1 

and » 
B= f b =b, + byte +b te. (2) 

n-1 


Guided by the rule for multiplying finite sums, we now consider 
all products of the form a,b,, arranged in an infinite "rectangu- 
lar" matrix 


a,b, aab, aab, ttt a,b, ttt 
a,b, a,b, a,b, ttt a,b, ttt 


a,b, a,b, a,b, tt a,b; ttt 


(3) 


a,b, a,b, a,b, ttt a,b, up 


There are many ways of arranging these products in a sequence. 
For example, we can enumerate products “by diagonals”, 
indicated schematically by 


LS fos 
a,b, azb, a3b, = 
4 4.44 
a,b; ab, a3b3 
L L 544 (4) 
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or “‘by squares," indicated by 





a,b; | azb, aab, ttt 





a,b, ajb; a3b,|--- 
a,b, ab, a3b4 see (3) 


This gives the sequences 


abı, a,b2, a;b,, G1b3, 42b2, ab, ... (4) 
and 


a,b,, 4,62, a2b2, a2b,, a ba 2,63, a3b4, a3b3, Gabi, ..., (5^) 


respectively. A series formed from a sequence like (4) or (5') is 
called a product of the series (1) and (2). Every such product has 
the same value if (1) and (2) are absolutely convergent, as shown 
by the following 

THEOREM (Cauchy's theorem). Jf two series (1) and (2) are 
absolutely convergent, with sums A and B, then their product, 
formed from the numbers (3) taken in any order, is also absolutely 
convergent, with sum AB. 

Proof. By hypothesis, the series 


a 
È lal = lail + laal + ++ + las] ton (1*) 
m=1 

and 

a 

> Ibal = Ibi + [bal Fn + [Bal + e (2*) 
both converge, i.e., have finite sums A* and B*, say. Making an 
arbitrary arrangement of the products (3), we get a series 


> a; br, = a; br, + ajbi, Toc a, br, Tc. (6) 
s=1 


To prove the absolute convergence of the series (6), we estimate 
its partial sums. Let N be the largest of the integers j,, k,,j2, 
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k2, 2 Ja» Ks. Then obviously 
Jaj, brl + |a; b, + + la; brl 

<S (la| + laa] + + + lawl) (bi] + [bal +--+ + bnl) 

x A*B*. (7) 
Since (7) holds for all s, the series (6) converges absolutely, as 
asserted. 

To determine the sum of (6), we rely on the absolute con- 
vergence of the series and Riemann's theorem to arrange the 
terms of (6) more conveniently. Enumerating these terms “by 
squares," as in (5), we amalgamate the groups of terms by which 
consecutive squares differ from each other, obtaining 
a,b, + (a,b; + a,b, + abi) 

+ (aiba + ab + a3b3 + a,b, + abı) Tc. (8) 
Then, letting Am and B, denote the partial sums of (1) and (2), 
we find that (8) has partial sums 

A,B, = abi, 
A,B, = (a, + a3) (b, + b2) 
AB, = (a, + a5 + a3) (b + bı + b3), 


which clearly converge to the product AB. But ABis the sum of 
(6), as well as of (8). Bi 

Remark. In actually carrying out multiplication of series, it is 
usually best to arrange the products (3) “by diagonals,” as in (4), 
and then amalgamate terms lying on each diagonal: 


AB = a,b, + (a,b, + abı) + (4,63 + azb + abi) + +. 
(9) 


This is the form in which Cauchy first represented the product of 
two series. Therefore (9) will henceforth be called the product of 
the series (1) and (2) in Cauchy’s form. 
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Example. Using (9) to multiply two power series 


a 
Ma 
n 
a 
ll 


m = dg + aX + 43X? + + aux" +, 


(10) 


Y, bx" = bo + bix + bax? +o + bx” + 
n=0 


(where x lies within the intervals of convergence of both series), 
we find that 


T: o 
Y ax" Y b,x" 
m=0 n=0 
= aobo + (aob, + abo) x + (Gobz + a,b, + Gabo) x? + +. 
(11) 
Thus the product of two power series in Cauchy’s form is 
automatically represented in the form of a new power series. The 
process leading from (10) to (11) is often described as “‘term-by- 
term multiplication" (in accordance with Cauchy's rule). 


PROBLEMS 
1. By multiplying the series 


1 ao 
I-z = Lea beet Pe tee tte (|x| < 1) 





by itself, prove that 


l| = » nx = l + 2x + 3x? + -e nxt pe 
(1 — x)? n=1 


(|x| < 1). 
2. By multiplying the series 





= y (-1 x" = l= x + x? — 4+ (LL) 4+ o 


(x| < 1) 
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by the series 
2 x" 
In(1 + x) = 2 (= D" — 
n= n 


2 3 
x" 
=x- 74% oe (pr 2% 4... 
2 3 n 


|x| « 1 
(Ruds., p. 117), prove that (ixl ) 


mA +9) _ S (Lay = x — rat x? 
Dx o x 2 


l l 
+ c(i tote exe To 
2 n 


(Ix| < 1), 
where H, is the nth partial sum of the harmonic series. 
3. Use term-by-term multiplication to prove the identity 
oo a 


A,X” = y a,x" 
[^] 


— X nz0 





or ` » 
Yax-(0-xY A», 


a 
u 
o 


where A, = ag + a; + -- + a, (for another proof, see Ruds., 
Prob. 1, p. 85). 

Comment. If one of the two series converges in the interval 
(—R, R), where 0 < R < 1, then so does the other (why?). 


4. Prove the identity 
1 1 . 2 
G++ x DÀ x Mee x 
a 2a+2 -4 a+4 
x re ong 1:3 2g 
2 2-4 


=i (14 P et to): 
a a+2 (a + 2) (a + 4) 














Where a > 0. 


2 Fichtenholz (2094) 
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5. Suppose it were not known in advance that the exponential 
function obeys the "addition formula” 


exe” — ext, (12) 


Prove that (12) follows from term-by-term multiplication of the 
series 

ao n 2 n 

=f ~~ al¢x4¢ 24-47 

n-0 n! 2! n! 








(Ruds., p. 113) by the same series with x replaced by y. 
Hint. Use the binomial theorem. 


6. Suppose it were not known in advance that the sine and 
cosine functions obey the “addition formulas” 


sin (x + y) = sin x cos y + cos x sin y, 
COS (x + y) = cos x cos y — sin x sin y. 


Prove that these formulas follow from term-by-term multiplica- 
tion of the series 








. d 2d x?n-! 
sin x =2 (—1) Qn - 1)! 
2x-X 4 BL (yp XT Tee, 
3! 5! (2n — 1)! 
cos x = X (-1» 2 < 
x? x* a xen 
Sio gr ta OM art 


(Ruds., p. 114), with appropriate changes of x to y. 


7. Find the square of the series 


] x (-1» E oy (x arbitrary). 
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Hint. First prove the combinatorial formula 
Y (Ci)? = Cr”, 
k=0 


involving the binomial coefficients 





n n! an _ Qn)! 
k!(n— kb)! 7 (nt? | 
Ans. 
Qn)! x?" 
jy 
1+5 ) 22^ (ay 


8. Square the series 


t) = ies (x D, 


representing the Riemann zeta function (Ruds., pp. 11, 45). 
Ans. We have 
c (n 
ror - Y 1, 
n 


where r(n) is the number of positive integers dividing n. 


9. Let Z(x) be the same as in the preceding problem. Prove 
that 
= l 
t = J] —. 
k=1 l 
l- — 
Pk 


where { p,} is the sequence of all prime numbers greater than 1, 
arranged in increasing order.” 





7. For example, p; = 2, pa = 3, Pa = 5, pa = 1, ... 
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Hint. Clearly 








1 1 1 
=l+ ux + 2x + mx + ? 
1 _ d Pk k k 
Pk 
and hence 
1 e 1 N ao 
B"-I-——-Y-—-X-* a 
PLAN l n=1 n* a=1 n* nzN41 


l1- — 
x 
Dk 
where the prime shows that the summation does not extend over 
all positive integers, but only over those (except for 1) contain- 
ing the numbers p,, P2, ..., py € N as factors. Therefore 


ao 
CY) l 
o<pm yt. x L, 
n=1 n* n=N+1 H 


a fortiori. But the right-hand side approaches 0 as N — oo (why?), 


and hence 


lim Py” = Y = 


N> 


10. Prove that 


TAEA ^ (14) 


Deduce from this that there are infinitely many primes. 
Hint. Formula (13) continues to hold if x = 1, and hence 





TIN l aS [| 
PP = [| —— >} —=4,. 


KN 1 n=1ı N 
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11. Prove that the series 


l 
— + 


l 
2 3 


l l L (15) 
5 Pr k=1 Pk 
diverges. 

Hint. Since the product (14) diverges, the series (15) also 
diverges (Ruds., Theorem 5, p. 96). 

Comment. This serves to characterize the rate of growth of the 
prime numbers, and is clearly a much stronger result than the 


fact that the harmonic series diverges. 


12. Prove that 
1 


3C 3C 969-62 


= |- — SL LL Lee (x « 1), 











where we use a plus or minus sign in the denominator of the ex- 
pression on the left depending on whether the factor in question 
involves a prime of the form 4n — 1 or of the form 4n + 1. 


5. Toeplitz’s Theorem 


We now prove a general limit theorem which will be needed 
later on (in Sec. 6 and Chap.4): 

THEOREM (Toeplitz’s theorem). Given an infinite "triangular" 
matrix 





for t22 


131 132 133 


m ta2 faa UT lan 
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of numbers tam (1 « m < n), suppose that the elements in each 
column converge to zero, i.e., 


tm >0 as n> oo (m fixed), (1) 


while the sums of the absolute values of the elements in each row 
are all bounded by the same constant K: 


ltal dal H bd EK (n= 1,2,..-). D 


Let (x,) be any sequence converging to zero, and let {x,} be the 
sequence with general term 


X, = tyyX, + faaXa oso tanXn- 


Then {x,} also converges to zero. 
Proof. Given any £ > 0, there is an m such that 


Ix «-5. if n>m, 
2K 
and hence, by (2) 
Ixnl < [tnt X1 tc tamXmal + [tnm+1%m4+1 tot tanXal 
€ 
< lta %1 tcc tamXml + LP tcc |tanl) ae 
2K 


€ . 
€ [tix tco tam ml + 3 if n>m. (3) 


But m is fixed in (3), and hence, by (1), there is an N > m such 
that 


|tiX + + fas <> if n» N. (4) 


Combining (3) and (4), we find that 
Ix <e if n>N, 


ie,x,—0asno oc. B 
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COROLLARY 1. Suppose the coefficients tam satisfy the condition? 
T, = tar + tra to + iml 
as n > 00, in addition to the conditions (1) and (2), and suppose 
lim x, = a 


nod 


(a finite). Then 


lim x, = lim (faiXi + faaXa cc + tan%n) = a. 


noc noo 


Proof. Clearly 
X, = ba (X1 — a) + faa (Xa — a) + + s (x, — 2) + Tha, 


where, by hypothesis, x, — a — 0 asn — cc. Hence, by Toeplitz's 
theorem, 
lim x, = lim Ta =a. M 


no net 


COROLLARY 2. If 


lim x, =a, 
noo 
then 
"P. x eX, 
lim 21+ %2 ton + =a. 





nc n 


Proof. Choose 


in Corollary |. B 
COROLLARY 3. Suppose 


lim x, = lim y, = 0, 


where 


lxi + lyal tcc Pal X K (n = 1, 2,...) 





8. In the applications, we usually have 7, = 1. ' 
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for a suitable constant K, and let 


Zn = Xiys + Xaya-i toot Xy 
Then 
lim z, — O. 
Proof. Choose tym = y, 441in Toeplitz’s theorem. Bl 
COROLLARY 4. Suppose 
lim x, =a, lim y, — b, 


noo no 


and let 
2o XiY2 + Xaya-i occ + Xi 

eT 
Then 

lim z, = ab. 

Proof. First let a = 0. Then z, — 0, by Corollary 3, if we 
replace y, by y,/n, noting that |y,| < K (why does K exist?) im- 
plies 


< MK _ y. 
n 


» 
n 


EA 
n 


Da 
n 


+ + + 




















If a # 0, we write 


-- (xı — a) Yn + (x2 — a) Yn-1 + + (Xn — 4) Yı 


n 
yalt It t^» 
n 


Then the first term on the right approaches zero, for the reason 
just given, while the second approaches ab, by Corollary 2. Bl 


PROBLEMS 


1. Given two sequences {x,} and {y,}, suppose that 
a) {yn} is an increasing sequence with limit + o0; 
b) lim ~2 i = g (Xa = Jo = 0). 
noc Yn — Yn-ı 


Operations on Series 





Prove that 
lim — = 
no Yn 
Hint. Choose 
Us = Ym — Ym-1 . 
Yn 
2. Given a sequence Xo, Xi, X2, ..., X,, ..., let 


xe Coxo + Cix, + Cix ++ + Cix, 
n 2 3 





where Ch is the binomial coefficient 


cee ms 0,1,.., n). 
m! (n — m)! 


Prove that x, > a implies x, > a. 
Hint. Let 





y Ch = 2" 
m=0 
3. Given a sequence xo, Xi, X2, ..., Xas ..., let 


ve Coxo  Crxiz  Czx4Z) + + Ctx, 2" 
(1 + zy 





ye Coxoz" + Cix,;z" | + Cixjiz"? + + + Chex, 
' (1 +2)" 





where z > 0. Prove that x, 9 a implies x, > a, xf a. * 
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6. The Theorems of Mertens and Abel 


We are now in a position to prove a theorem generalizing 
Cauchy's theorem on the multiplication of series: 
THEOREM | (Merten’s theorem). Given two convergent series 


Yo a,= 4, +a. tetant (1) 
n=1 

and 
$ bbi + bp +e +b ter, (2) 
n=1 


with sums A and B, respectively, suppose at least one of the series 
is absolutely convergent. Then the product of (1) and (2) in Cau- 
chy’s form is convergent, with sum AB, i.e., 
AB = a,b, + (a,b,  a;bi) + (aiba + a,b, + a3b,) t. 
(3) 
Proof. Suppose the first series (say) is absolutely convergent, 
i.e., suppose the series 


E: 
2. lan] = lei] + la2l + +++ + ded + ce (4) 

is convergent. Combining terms on the nth diagonal of the 
matrix (3), p. 13 we write 

€, = Gib, + a3b,, + ++ + an-1b2 + anbi, 
so that the series on the right in (3) is just 

€, Co os tate, 

with partial sums 

C,—-c, +e tet C (n = 12, ...). 


Thus our aim is to show that C, > AB asn — œ. First of all, it 
is easy to sec that 


C, = a, B, + a,B,-1 tec a, B; + a,B, , 


Operations on Series 27 


where B, is the nth partial sum of the series (2). Setting B, 
= B — f, (where the remainder f, > 0 as n — œ), we can write 
C, in the form 

C, = A,B — Yn, 


where A, is the nth partial sum of the series (1) and 


Yn = dis + aabn-1 oc + Gy-1B2 + abi. 
Since A, > A, everything reduces to showing that 
lim y, = 0. 
But this follows at once from Corollary 3, p. 23 (with x, = fn, 
Yn = 4n), if we bear in mind that 


la,| + laal +--+ + lal < A* = (n = 1,2,...), 


where A* is the sum of the series (4). BM 

Example 1. It cannot be asserted that the series on the right 
in (3) converges if both series (1) and (2) are only conditionally 
convergent. For example, suppose we try to multiply the con- 
ditionally convergent series 


c (-1)-! 1 l 1 
Cor" = 1] —- — + — ++ + (- 1)? — + ee 


"1 = v2 v3 Vn 
(Ruds., Prob. la, p. 76) by itself. This gives 


l l 


La Jahn i 





e = co 





l l 
+ ——— H + . 
VkeVn—k +1 A3] 
But |c,| > 1, since 
l l 


— > — 
VkVn—-k+1 n 
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and hence 


diverges. 
Example 2. On the other hand, suppose we multiply the con- 
ditionally convergent series 


bel (-1)7! ] 1 
In 2 = — = 1 —-—+——* 
p3 n 2 3 


+ (pL +e 
n 


(Ruds., p. 117) by itself. This gives 


Cn = (-1y^! x 


x(—L yt yoy l| peH 
len 2(n — 1) k(n — k * 1) n:] 


2 1 
= —]y-! 
(7D os nek ed 


—7\yp-1 n" 
-OD y li, 1 | 
n+l «=0\k mn—k-cl 


=(-1)""! 2 p4t4.44), 
n+l 2 n 








Thus {|c,|} is a decreasing sequence converging to zero (why?), 
and hence 


Y Cy (5) 


converges by Leibniz’s test (Ruds., p. 73). It is now natural to 
ask whether the sum of (5) is (In 2)?. The answer is affirmative, as 
shown by the next theorem. 


Operations on Series 29 
THEOREM 2 (Abel’s theorem). Given two convergent series (1) 


and (2), with sums A and B, respectively, suppose their product 


a 
È cen =c tea t tate 


aci 
is convergent, with sum C. Then 
C — AB. 
Proof. With the same notation as before, we easily find that 
C, + + +C, = A,B, + A,B; s + AB. 
It follows that 


. C; + Cic: C, 
lim <> — —* 


noo n 








m A,B, + A;B,., +e + AÁnBn—1ı 
no n i 
But the left-hand side equals C, by Corollary 2, p. 23, while the 


right-hand side equals AB, by Corollary 4, p. 24 (with x, = An, 
Yn = B,). a 


PROBLEM 


Suppose the power series 


has the interval of convergence (— R, R), where R < 1, and 
suppose the series converges (possibly only conditionally) at the 
end points x = +R. Prove that the identity in Problem 3, p. 17 
continues to hold for x = +R. 


CHAPTER 2 


Iterated and Double Series 


7. Iterated Series 


Given infinitely many real numbers 
af? (j,k = 1,2,...) 


indexed by two integers j and k, imagine these numbers arranged 
in an infinite rectangular matrix 





(1) d) 21) (SS 


a; d» Gy "dj 
(2) (2) (2) (2) 
a dy d3 ay 
3) (3) (3 [E] 
ac ay a? as» 
(1) 
k k k k 
a? as? as? ay. 


Suppose we first sum the elements in each row of (1) separately, 
obtaining an infinite sequence of series of the form 


y aj?  (k—-12,..), (2) 


and then sum the terms of this sequence in turn, obtaining the 


expression o œ 
LÈ a, (3) 
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called an iterated series. Alternatively, if we sum the matrix (1) 
first over columns and then over rows, we get another kind of 
iterated series, of the form 


Ma 


3 ai^. (3) 
k=1 


li 


J-1 
DEFINITION 1. Suppose summation of the elements in the kth 
row of (1) gives a convergent series, with sum A“, for every 


k = 1,2, ..., and suppose the series 


18 


AO (4) 
k=1 
is convergent, with sum A. Then the iterated series (3) is said to be 
convergent, with sum A. 
DEFINITION l’. Suppose summation of the elements in the jth 
column of (1) gives a convergent series, with sum Aj, for every 
j= 1,2,..., and suppose the series 


D A, (4) 


is convergent, with sum A'. Then the iterated series (3') is said to be 
convergent, with sum A'. 

The elements of the matrix (1) can be represented as an ordin- 
ary sequence 


Uy, Uz, cee Hp, ore (5) 


in infinitely many ways, and there is an ordinary series 


È u, (6) 


corresponding to each such sequence.' Conversely, given any 
ordinary sequence (5), the terms of the sequence can be arranged 
in infinitely many ways (without regard for order) to make up a 





1. A similar situation has already been encountered in connection with 
the matrix of the special form (3), p. 13. 
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matrix of the form (1), and there is an inerated series of the 
form (3), say, corresponding to cach such arrangement. Thus it 
is natural to ask about the relation between the series (3) and 
(6). This is done in the following two theorems: 

THEOREM 1. If the series (6) is absolutely convergent, with sum 
U, then, no matter how its terms are arranged as a matrix of the 
form (1), the corresponding iterated series (3) is convergent, with 
the same sum U. 

Proof. By hypothesis, the series 


> lu, (6*) 
r=1 
is convergent. Let U* be its sum. Then, given any k and n, 


n 
Y. aP] < us. 
j-1 
Therefore 


since an absolutely convergent series is always convergent 
(Ruds., Theorem 1, p. 63). Moreover, given any € > 0, there is an 
integer rg such that 


ao 
> Iul <e, (7) 
r=ro+1 
and hence, a fortiori, 
ao fo 
» w-U-yw«ct:. (8) 
r=Fřo+1 r=1 











The terms u, , u5, ..., u,, Of the series (6) all belong to the first m 
columns and the first n rows of the matrix (1) if m and n are 
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sufficiently large, say if m > mg, n > no. Therefore, by (7), 


È Ya- yu, 


r=1 


«E (m > mg, n > no); 








since the expression whose absolute value appears on the left is a 
group of terms u, with indices greater than ro. Taking the limit 
as m > œ, we get 


n Fo 


È AXQ — y. u, 


k=1 r=1 


<E (n > no), 








which, together with (8), implies 





Lao — u| < ze, 


and hence 
ao 


$ AM) = lim y AOo-U. E 
k=1 now k=1 

Remark. Theorem 1 obviously continues to hold in the case 
where some of the rows of the matrix (1) contain only finitely 
many terms. 

DEFINITION 2. The iterated series (3) is said to be absolutely 
convergent if the iterated series 


x Y a”, (9) 


whose terms are the absolute values of those of (3), is convergent. 
Remark. Similarly, the iterated series (3’) is said to be absolute- 
ly convergent if the series 


is convergent. 

THEOREM 2. Suppose the iterated series (3) is absolutely con- 
rergent. Then (3) is convergent, and the series (6) made up of the 
elements of (1) arranged in any order whatsoever is absolutely 
convergent, with the same sum as (3). 


3 Fichtenholz (2094) 
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By hypothesis, the series (9) is convergent. Let A* be its sum. 
Then, given any m and n, we have 


m 


Y. Y qa? < 4*5. (10) 
k-1j-1 
Consider any partial sum 
U? = |u| duo] ono dul 


of the series (6*). The numbers 1, , 1, ..., u, all belong to the 
first m columns and the first n rows of the matrix (1) if m and n 
are sufficiently large. Hence (10) implies 


U* < A* (r=1,2,...), 


so that (6*) is convergent, i.e., (6) is absolutely convergent. The 
rest of the proof is now an immediate consequence of Theo- 
reml. B 

Remark. Clearly, Theorems 1 and 2 remain true if (3) is re- 
placed by (3^). 

THEOREM 3. Given a matrix (1), suppose the iterated series (3) is 
absolutely convergent. Then the iterated series (3') converges and 
has the same sum as (3): 


ha = y} 2a. 
j=1k=1 k-1j-1 

Proof. By Theorem 2, the series made up of the elements of (1) 
arranged in any order whatsoever is absolutely convergent. 
Hence, by Theorem 1, the iterated series (3) corresponding to the 
matrix (1) as it stands and the iterated series (3), which is of the 
form (3) if we interchange rows and columns in the matrix (1), 
both converge and have the same sum. B 

Remark. Clearly Theorem 3 remains truc if we interchange the 
roles of (3) and (3’). 
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PROBLEM 


Interpret Theorem 1 as a generalization of both Theorem 1, 
p. | and the theorem on p. 5. 


8. Double Series 


There is another kind of series associated with the infinite 
rectangular matrix (1), p. 30, namely the series of the form 


aj) aP te b ae 

4 at? 4 af? ter tal? usus 

+- 

tay aP eaa 

pee ; 

called a double series and denoted by 
Y af? (1) 
J,k-i1 


(with only one summation sign). By a partial sum of (1), we 
mean a finite sum of the form 


nm n 
AP = Y Yap, 
J=1k=1 
made up of the terms in the first m columns and the first n rows 
ofthe given matrix. Let m and n approach infinity independently. 


Then the limit? 
A = lim A£? (2) 


mx 
n-do 





2. The limit in (2) is a double limit. Thus if A is finite, (2) means that, 
Biven any e > 0, there is an integer N such that 


lat Al <e 


whenever m and u both exceed N. 
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(finite or infinite) is called the sum of the double series (1), and 
we write 


The series (1) is said to be convergent if it has a finite sum, and 
divergent otherwise. 

It is now natural to compare the double series (1) with the 
iterated series 


NC = k 
Y a (3) 
kK=1j=1 
and 
ao ao 
k 
> Ya. 3? 
J=1lk=1 
Since 
n m 
AM = X Y at? 
k=1j=1 
we have 


lim AP = y, A®, 
k=1 


moo 


after taking the limit as m — œ for fixed n. Here 
oo 
AO = Vaf? (k= 1,2,...), (4) 
J=1 
and every "row series" on the right is assumed to converge. Thus 
the sum of the iterated series (3) is just the iterated limit 


lim lim A™. 


Similarly, the sum of (3^) is the other iterated limit 


lim lim AZ? 


m-»uw noo 


(give the details). 


THEOREM 1. If the double series (1) converges and if every “row 
series" (4) converges, then the iterated series (3) also converges and 
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has the same sum as the double series: 


a ao a 
C k) v QU) 
la = $a. (5) 
k-1J-1 j-k=1 
Proof. Given any & > 0, there is an integer N such that 

aP = Al <E, 


provided that m, n > N. Holding n > N fixed, we take the limit 
as m > oc, obtaining 





y. 4 - 4|««. 


Taking the limit as n — oo now gives 





549- A) ce, 


which implies (5). M 

Remark. 'There is an obvious analogue of Theorem 1 for the 
casc of the iterated series (3°). 

DEFINITION 1. A double series (1) such that 


a>0 (fk =1,2,..) 


is said to be positive. 

For such series we have the exact analogue of a familiar result 
for ordinary positive series (Ruds., Theorem, p. 9): 

THEOREM 2, A positive double series always has a sum. The sum 
is finite, and hence the series converges, if the partial sums of the 
Series are bounded from above. Otherwise the sum is infinite, and 
hence the series diverges. 

Proof. The last assertion is obvious. To prove that a positive 
double series (1) converges if its partial sums are bounded, 
Suppose 

ADP <K  (mn=1,2,...); 
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and let A be the least upper bound of the numbers A5. Then A 
is the sum of (1). In fact, given any € > 0, there is a partial sum 
Age such that 

An > AE, 


by the very definition of A. Choosing m > ma, n > ng, we have 
AP > Ae, 


a fortiori, since At) obviously increases with both m and n. 
Hence 
AP? — Al «c 


if m, n > N = max (ms, No}, since no partial sum exceeds A. 
But then 
A = lim A®, 


m> Tr 
n—= 0 


as asserted. W 

Next we consider arbitrary double series, i.e., double series 
whose terms can have values of either sign. Just as in the case of 
ordinary series, we need not consider the case where all the terms 
of the series are negative or the case where there are only a finite 
number of positive or negative terms, since these cases immedi- 
ately reduce to the case of positive series (cf. Ruds., p. 63). Thus 
we will assume that the double series (1) has both infinitely many 
positive terms and infinitely many negative terms. 

The following definition and theorem are the exact analogues 
of those for the case of ordinary series (Ruds., pp. 63, 65): 

DEFINITION 2. A double series (1) is said to be absolutely 
convergent if the series 


È, lal (1*) 


j.k=1 


made up of the absolute values of its terms is convergent. A double 
series which is convergent but not absolutely convergent is said to 
be conditionally convergent. 
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Remark. Thus (1) is absolutely convergent if and only if the 
double series corresponding to the infinite rectangular matrix 


lat? laf? --- Jas] -- 
( 2 

lat? laf? --- Ja PI -- 

lat? lat? u lat? u 


is convergent. Similarly, the interated series (3) and (3’) are ab- 
solutely convergent if and only if the iterated series correspond- 
ing to this "absolute value matrix" are convergent (cf. Defini- 
tion 2, p. 33). 
THEOREM 3. Jf the series (1*) converges, then so does (1). 
Proof. Let 


(kK) — (0 d) 
a; =p; — 4; 
where 
(k) (k) s 
«la; | +a œw _ la 


J , j 


2 


Since 
pt? < la? ; qi < la |, 
the convergence of (1*) implies that of the double series 
a kL 
Y» -PR Ya -Q 
Ji k-i Jka 


(see Problem 5). But then the series 
Y d" - Y ui" - fh 
Ake J.k=1 


also converges (see Problem 3), and in fact has the sum A = 
P-Q. M 

Finally we prove a result analogous to Theorems | and 2 of 
the preceding section: 
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THEOREM 4. Given a double series (1), let 
2 u, (6) 
1 


be an ordinary series consisting of the same terms written in any 
order whatsoever. Suppose either of the series (1) and (6) is ab- 
solutely convergent. Then so is the other series, and both series 
have the same sum. 

Proof. Suppose (1) is absolutely convergent, so that (1*) is 
convergent with sum A* (say). Then, just as in the proof of 
Theorem 2, p. 33, it is casy to sce that 


U? < A* (r = 1,2,...), (7) 
where 
U? = jul us ceo dus 


is the rth partial sum of the series 


> du. (6*) 
r=1 
But (7) implies the absolute convergence of (6). 

Conversely, suppose (6) is absolutely convergent, so that (6*) 
is convergent with sum U*. Then, given any partial sum 


Ax" — Y Y la (8) 
J=1k=1 

of the double series (1*), there is an integer r so large that all the 

terms in the right-hand side of (8) are among the first r terms 

of (6). It follows that 


Af" <U* (mn = 1,2,...), 


which in turn implies the absolute convergence of (1), or, for 
that matter, of either of the iterated series (3) and (3’). 

Finally, to calculate the sum U of the series (6), we use its 
absolute convergence to suitably rearrange its terms. Suppose 
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we cnumerate the terms of (6) *by squares,” amalgamating the 
groups of terms by which consecutive squares differe from each 
other in the array 


a? 





Then 
U = aj? + (ai? + aS? + aV?) 


(3) (3) 3) 


+ (ai) + a 4+ ag (2) 


(1) 
+ a3 


+ 43 ) Tc 


and hence 
U = lim AX” = A, 

where A is the sum of the double series (1). BM 

COROLLARY. The double series (1), the ordinary series (6) consist- 
ing of the same terms written in any order, and the iterated series 
(3) and (3’) all converge and have the same sum, provided at least 
one of the four series is absolutely convergent. 

Proof. Combine Theorem 4 with Theorems 1—3 of the preced- 
ing section. Bl 


PROBLEMS 


1. Given two convergent series 


oo 


Yya-2a +a t tate (9) 


j-1 





3. The word "absolutely" is unnecessary if all four series are positive. 
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and 


1 


k= 


with sums A and B, respectively, consider the double series 


Le = Y ab. (11) 
J. k-1 J. K-21 
Prove that (11) converges and has sum AB. 
Hint. In terms of partial sums, 


Ch = AmBns 
and hence, 
C = lim AmB, = AB. 

Comment. Thus, if we define the product of the series (9) and 
(10) as the double series (11), the sum of (11) always equals the 
product of the sums of (9) and (10). The niceties of Secs. 4-6 
arise only when the product of (9) and (10) is taken to be an 
ordinary series. 


2. Suppose every term of a convergent double series with 
sum A is multiplied by the same constant c. Prove that the result- 
ing series converges and has sum cA. 

Comment. This problem and the next two generalize familiar 
properties of ordinary series (Ruds., Theorems 3-5, pp. 7-8). 


3. Prove that two convergent double series can be added (or 
subtracted) term by term. 


4. Prove that if the double series 


c k 
Y a 


converges, then 
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Hint. Note that 
tk) (k) (k) (k-1) (k~1) 
a; = Aj — A; — Aj T Áj-i . 


5. State and prove the analogue for positive double series of 
the comparison test for ordinary positive series (Ruds., Theo- 
rem 1, p. 12). 


9. Examples 


We now give a number of example illustrating the theory of 
the preceding two sections. 
Example 1. Consider the infinite rectangular matrix 


2 3 


X —x? x —x x 
x(l-x) -—x?(1—x?) x?(1— x?) —x3(1—x3) x?(1— x3) 


x(1—x)? —x?(1—x?)? x? (1 x??? — x3: (1—x?? x3(1— xy? -- 


Here the “row series" are absolutely convergent, with sums x, 
a(l — x) x(1 — x)?,..., and the series made up of these sums 
is also absolutely convergent, with sum 1. However, the other 
iterated series docs not converge, since the "column series" have 
sums alternately equal to +1 and — 1. This does not contradict 
Theorem 3, p.34, since neither iterated series is absolutely 
convergent (why not?). 

Example 2. Suppose q ranges over all positive integers of the 
form m", where m and n are both positive integers greater than 1, 
taking each such value just once. Prove that 


=1. 





G=y— 


a q—1 


Solution. If m ranges over all positive integers ( 1) which are 
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not powers, then 














1 
G= + + 
area L1 
1 1 
- + + 
m(m—1 m-1 
1 1 1 
tutt) 
1 1 1 
+(—+—+54+-)+ 
m m 
1 
m? 


1 l l 
CE 


(justify the various rearrangements). It follows that 
e 
1 


a2 n(n-l) 


where n now ranges over all positive integers starting from 2 


Therefore e ( 1 -4) E 





Example 3. Consider the matrix with general term 
w- k- ___ G- 
IG+)- +k) k(k+1)e(k+j) 
(where 0! = 1). Setting « = 0, p = k in the formula 
y 1 
n=1 (x t n)(a n +1) (x +n + p) 
_ 1 
p(w + p) (x + p) 


(1) 
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(Ruds., Prob. 2, p.4) we can easily sum the terms of the 


kth row: 
r 5 a 67D 1 


mA? kek! ok 


Hence the sum of one iterated series is 


= —, 2 
às A” à k? 2) 


Because of the symmetry of at? with respect to j and k, the other 


iterated series is identical with the first, and nothing new can be 
deduced by equating the sums of the two iterated series. 
Suppose we now modify the matrix as follows: We retain the 
first k — 1 terms in the kth row, but replace the kth term by the 
sum of all the terms of the kth row starting from the kth, drop- 
ping the remaining terms altogether. This gives the new matrix 





tk) tk) (k) (k) 
d, a2 a3 Utükoa Fk 
(k*1) (1) | (F1) (k*1) 1) 
ay a2 a3 **Ok-1 dy Peta 


with the same “row sums" as the original matrix. Hence the sum 
of the first iterated series has the same value (2) as before. To 
sum the matrix “by columns," we first calculate 


2 0o € (k — 1)! 
€ (k — 1)! 
= 2b, (k—-1 +n) (Qk — 14 n) 
(k — 1)! 


BILOM TUM LL, 3 
k? (k +1) Qk — 1) ©) 
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using formula (1) with x = k — 1, p = k. The sum of the re- 
maining terms of the kth column equals 





S D © o k- 
ut Pu 1): G 4 k) 
NE (k — 1)! 
is (k + n)(k- n1) (2k + n) 
-E-D . (4) 
k(k + 1) 2k 


where we set x = p = k in (1). It follows from (3) and (4) that 
the sum of all the terms in the kth column is just 


(k — 1)! G "m 
k(k + )-- (2k — 1) \k x) 
(k — 1)! 2344 - DË 
k(k + 1) (2k — 1) 2k 2k) 





Using Theorem 3, p. 34 to equate the sums of the two iterated 
series, we arrive at the interesting formula 
eol e K-D 
ytasy EDT, 


k=1 (2k)! 6) 


The series on the right converges very rapidly, thereby facilitat- 
ing the approximate calculation of the sum of the important 
series on the left.* 

Example 4. Investigate the convergence of the double series 


m 1 
— 0). 6 
i21 (j + ky (> 0) (6) 


4, An argument which will not be given here shows that this sum equals 
z?[6. See G.M. Fichtenholz, Functional Series (in the Pocket Mathemat- 
ical Library), Scc. 7, Problem 7b. 
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Solution. Arrange the terms of (6) as an ordinary series, com- 
pining terms on each diagonal of the corresponding matrix. 
Since the terms on each diagonal are equal, this gives 


= 1 
Y a-l. (7) 
n=2 n 

But clearly 


la<n-1<n, 
2 


and hence, dividing by n^, we get 


1 


a— 


l 1 
2n! 








&«(n- 0 « 
n 


It follows by the comparison test that (7) converges ifa > 2 and 
diverges if a < 2. Therefore, by Theorem, 4 p. 40, the same is 
true of the double series (6). 


PROBLEMS 


1. By applying Theorem 3, p. 34 to the positive matrix 
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(the missing elements can be replaced by zeros), prove that the 
harmonic series 
1 1 
+> +e t ee (8) 
2 n 
must diverge. 

Hint. If (8) had a finite sum s, then one iterated sum would 
equal s, while the other would equal s — 1, contrary to the theo- 
rem. 

2. Prove that 


o an 1 
m-2k-2 m* 
(the same power can occur more than once in the left-hand side). 


3. If |x| « 1, the Lambert series 





ae) = Y a—— (9) 


— xX 


converges for precisely the same values of x as the power series 
f(x) 2 ax (10) 
n-1 


(Ruds., Prob. 3, p. 86). Let R > 0 be the radius of convergence 
of the series (10) and suppose |x| < R as well as |x| < 1. Prove 
that 


q(x) = E 


where 


Og = £ a, 
k|n 
and k|n means that the sum is restricted to those positive integers 
which are divisors of n. 
Hint. Noting that 





=H Mp Wax" (lx < 1), 
1— x" 
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consider the matrix 





a,x a,x? ax? a,x* a,x’ ayx® ax? a,x’ a,x? axl? + 


a,x? axt a,x* ax’ ajx1? ... 


asx!’ e 


asx (11D) 





a, ox! «+ 


where identical powers of x appear in the same column and 
empty spaces can be replaced by zeros. Now equate the corre- 
sponding iterated series (why is this justified?). 


4, Prove that 


o x? o 
——— = t(n) x^, 
n=i1 1 — x” 2 (n) 
ne" = $ o(n) x", 


a=1 1— x" n=1 


where t(n) is the number of divisors of n and o(n) is the sum of 
the divisors of n. 

Hint. Use the result of the preceding problem. 

Comment. It is easily verified that R — 1 in both cases, so that 
we need only assume that |x| < 1. 


^ Fichtenholz (2094) 
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5. Prove that 
so) = 3 foo), (12) 


where the functions g and f are the same as in Problem 3. 
Hint. Arrange the elements of the matrix (11) without "gaps," 
in the form 





ax a,x? aX? a,x^ -- 


axla,x*a,x5 a,x? .- 
a4x?a4xPa4x?. a,x? --- 


a4x^ a,x* a4x!? aax! --- 


6. Prove that 
ax" 


œ (ax)" | 00 
2 i-x 2 I ae (la| < 1, |x| < 1). 





Hint. Use (12), choosing a, = a". 
7. Given two power series 


F(x) = 2, mX”, g(x) = 2, bax", 


prove that 


Dank (x") = 2. baf G7) (|x| < 1), 


where x is such that both series converge absolutely. 
Hint. Consider the matrix with elements a,,b,x™", noting that 


lab,x"^| < |asx"| |Bnx"| 


since mn > m + n (m > l, n > 1), from which it follows that 
the corresponding double series is absolutely convergent. 
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Comment. The choice b, = 1 (n = 1,2, ...) gives (12), since 


en 
th x 


g(x) — 





1- x 


8. Prove that the "power series in two variables” 


Ms 


x!y* (13) 


J,k=0 
is absolutely convergent if |x| < 1, |y| < 1 and divergent other- 
wise. 

Hint. Use Cauchy’s theorem (p. 14), noting that (13) is the 
product of the two ordinary power series 


yx, Y». 
J=0 k=O 


Comment. The study of power series in two variables is pur- 
sucd in the next section. 


9. Prove that the double series 
c 1 
jkei jk? 





(x > 0, B > 0) 


is convergent if x > 1, 8 > 1 and divergent otherwise. 


10. Consider the double series 


XU i t (Aj? + 2Bfk + Ck?Y e>, 09 
where the quadratic form Ax? + 2Bxy + Cy? is positive defi- 
nite, so that 4 = AC — B? > 0, as well as A > 0, C > 0. Prove 
that (14) converges if o > 1 and diverges otherwise, thereby 
Beneralizing Example 4. 

Hint. If M is the largest of the numbers | A], |B| and |C], then 


1 1 
wy) 5 S 
^07 M? (7 + ky* 
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Moreover 
a = 1 KAC — mp + (Bj + CO > £ j, 
C C 
and hence 


o o 
aj? X (5) L , aj? X (3) n 
J 


which implies 0l 
"» (X JcN 1 
J Sa A ju . 





11. Give an example showing that in Theorem ], p. 36, one 
cannot drop the condition that every row series be convergent. 
Hint. The double series corresponding to the matrix 





is convergent, with sum zero, but its row series diverge. 


12. Sum the following double series: 





= 1 = 1 
—— —1); b ; 
a) 2. (p + n)” (p > ) ) da Qn)" 
: 1 c. 1 
c) 2. (4n — 1)2"+2 , m/nci (4n — 1)" , 
a 1 


9 sn 1pm 
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Hint. Resort to iterated series, first summing over m. Use the 
expansions 





In2 = -l.lo l.,., 
2 3 4 
zc 1 1 1 
—=1-—+—-—+- 
4 3 5 7 
(Ruds., pp. 115, 117). 
Ans. 
a) l ; b)ln2; yee Linn; d) + ina; e). 
ptl 8 2 4 8 


13. Consider the function of two variables 


g (x, z) =e” =z) (z # 0). 
Prove that? 


p(x z) = È J,(x) z^, (15) 
where 
i - Cn» x 2k+n 
AG) = 2. ki (k +n)! (5) 
ifn 2 0 and 
J,(x) = 2, k!(k +n)! (3) 


ifn < 0. Show that 
J_A(x) = (— 1)" J,(x). 
Hint. Multiply the absolutely convergent series 


eD z -y x ^g eg Ce -y x k (—1)} z-* 
o\2) j? Zo \2 k! 


(Ruds., p. 113) to get the absolutely convergent double series 


p (x. z) = y eu CY uk 


Hkz0 2 j'k! 





5. X a,isshorthand for the sum X a,4 X a. 


n--—oa n=0 n=l 
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Comment. The function J4(x) is called the Bessel function of 
order n, and plays an important role in mathematical physics, 
celestial mechanics, etc. Because of the expansion (15), the func- 
tion g (x, z) is called the "generating function" of the Bessel 
functions. 


10. Power Series in Two Variables 


By a power series in two variables x and y is meant a double 
series of the form 


Ma 


aux! K, (1) 


involving nonnegative integral powers of the variables x and y 
multiplied by numerical coefficients ają. Just as in the case of 
ordinary power series in a single variable (Ruds., Sec.11), we 
now consider the problem of finding the “‘region of convergence" 
of (1), i.e., the set of all points M = (x, y) for which (1) con- 
verges. 

LEMMA. If the power series (1) converges at a point M = (X, y) 
whose coordinates are both nonzero, then it converges absolutely at 
every point M = (x, y) satisfying the inequalities |x| « |x|, 
]y| < |p|, i.e., in the whole open rectangle with center at the origin 
and vertex at M. 

Proof. The proof is virtually the same as in the single-variable 
case (Ruds., p. 68). Suppose the series 


zik 
» a X! y 
J. k-ü 


converges. Then its general term approaches zero (see Problem 4, 
p. 42), and hence is bounded, i.e., 


laž "l X C QG, k = 0, l, 2, ws) 


for some constant C. Therefore 


d 


lax y*| = |ay,x4p*| 
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But the expression on the right is the general term of a conver- 
gent double series (see Problem 8, p. 51), provided that |x| < |x|, 
ly| < |F|. It follows by the comparison test (see Problem 5, p. 43) 
that (1) is absolutely convergent and hence convergent, by Theo- 
rem 3, p.39, fil 

Remark 1. The only power series in two variables to be con- 
sidered here are those for which there exists a point M satisfying 
the conditions of the lemma. 

Remark 2, It is clear from the lemma that we need only study 
the behavior ofthe series (1) in the first quadrant of the xy-plane, 
since if (1) converges at a point M — (x, y), it must also converge 
at the points obtained by reflecting M in the x and y-axes as well 
as in the origin. 





Figure 1 


Consider a ray OL in the first quadrant, making angle 0 with 
the positive x-axis (see Figure 1). Then, by the exact analogue of 
the argument in the single-variable case (Ruds., p. 69), there is a 
positive number R(0), possibly infinite, such that the series (1) 
converges absolutely for every point M on OL satisfying the 
condition — 

ndition OM < R(0) 
and diverges for every point M on OL satisfying the condition 


OM > R(0). 


6. The distance from O to M is denoted by OM. 
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Note that if R(@) = +œ for even a single ray, then, by the 
lemma, the series (1) converges (absolutely) in the whole xy- 
plane, i.e., the "region of convergence" reduces to the whole xy- 
plane, 

Excluding this case of an “everywhere convergent” series, we 
now assume that R(0) is finite for all 0. Let M, be the point of 
the ray OL such that 


OM, = R(0). 


Then the “boundary point" M, separates the points of the ray 
for which (1) converges (absolutely) from the points for which 
(1) diverges. At the point M, itself, the series (1) may or may not 
converge, depending on the particular series under considera- 
tion, Drawing the vertical line PP’ and the horizontal line QQ’ 
through M,, as shown in the figure, we can assert (using the 
lemma) that the series certainly converges inside the rectangle 
OPM,Q and diverges inside the (right) angular sector Q’M,P’. 
Therefore on a new ray OL’, corresponding to another angle 0’, 
the series must converge at every point of OA and diverge at 
every point of BL’. Hence the boundary point Ma, must lie be- 
tween A and B on OL’. This makes it clear (why?) that R(6) 
varies continuously as 0 varies from 0 to 2/2. In other words, the 
point Mg describes a continuous “boundary curve" as Ü varies 
from 0 to 2/2. Since the abscissa xg of the point Mg is non- 
decreasing as 6 > 0 while the ordinate yg of M, is nonincreasing, 
xg and yg must both approach limits as 6 — 0. Hence R(@) must 
also approach a limit as 0 — 0. Suppose this limit 
Ro = lim R(0; (2) 
650 

is finite, Then, as 0 — 0, M, approaches a limiting point Md 
—(Ry,,0)onthe x-axis,’ If (2) isinfinite, the boundary curve must 


7. The limiting point Më need not coincide with the boundary point Mo 
on the x-axis itself. In fact, Mo may lie to the right of Mf (or even lie at 
infinity). This possibility does not contradict the lemma, which applies only 
to points off the coordinate axes. 
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have an asymptote parallel to the x-axis, which may coincide 
with the x-axis itself. The same considerations apply to the case 
where 0 > z[2, with the roles of the x and y-axes interchanged. 

The above construction gives the boundary curve in the first 
quadrant. To complete the construction, we now reflect this por- 
tion of the boundary curve in both axes and in the origin. This 
gives the full boundary curve, determining the "region of con- 
vergence” M. In fact, the series (1) converges in the part of the 
plane lying inside the boundary curve and diverges in the part of 
the plane lying outside the curve.” On the boundary curve itself, 
the series may or may not converge, depending on circumstances. 


PROBLEMS 
1. Sketch the region of convergence for the series 
x!y G) 


(already considered in Problem 8, p. 51). 
Ans. The square shown in Figure 2. 





Figure 2 


8. Except possibly on the parts of the coordinate axes lying outside the 
curve, where it may turn out that the series converge (see footnote 7). 
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2. Whatis the sum of the series (3) inits region of convergence? 
I 1 


Ans. . 
1—-x1-—y 








3. Find the region of convergence of the series 


8 


differing from (3) in that the summation indices begin with 1 
rather than O. 

Ans. The same square as in Problem 1, together with the co- 
ordinate axes themselves. 

Comment. In this case, even though the boundary point M, 
approaches the point Mg = (1, 0) as 0 — O, the series converges 
on the whole x-axis (cf. footnotes 7 and 8). 


4. Find the region of convergence of the series 
ae x!y* 
sno jik!’ 





Ans, The whole xy-plane. 
5. Find the region of convergence of the series 


(j+ k)! 


x!y*. 4 
Jk-o tk! 7 @ 


Hint, A necessary and sufficient condition for the absolute con- 
vergence of the series (4), i.e., for the convergence of the series 


= (+k)! ; 
y GEE yup, (4) 
jk=0 j!k! 
is the convergence of the series 


1 


Y (x + [yy =| — 
h t= C i 
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obtained by summing (4^) “by diagonals.” This leads to the con- 
dition |x| + |y| « 1. 
Ans, The square shown in Figure 3. 


y 





Figure 3 


6. Find the region of convergence of the series 
Y yk 2 px x? fee + xy + oxty ox tire 
jzmk 
+ x2y? + x3y? + x*y? +, (5) 
Hint, A necessary and sufficient condition for the absolute 
convergence of the series (5), i.e., for the convergence of the 
series 
> Ixl 1»1*, (5) 
Jzk 


is the convergence of the series 


( + |x| + [xl? +) 0 + [xy] + dxyl? + +) 


1 1 
1 — |x| 1 — Ixyl 


obtained by summing (5’) "by rows.” This leads to the condi- 
tions |x| < 1, |xy| < 1. 
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Ans. The region shown in Figure 4, bounded in part by the 
equilateral hyperbolas xy = +1. 





Figure 4 


7. Generalizing double series, discuss multiple series of the 


form? 
ao 


Y a4 (6) 


Jeki 171 


and power series in several variables, of the form 


How should the sum of a series like (6) be defined? 


9. In discussing iterated and double series, we favored the notation ac? 
over the simpler notation ajx, merely to emphasize the distinction between 
rows and columns in the infinite matrices figuring in Secs. 7-9. 


CHAPTER 3 


Computations Involving Series 


11. General Remarks 


We now consider the problem of using infinite series to make 
approximate computations. Suppose we want to calculate a 
number A which is known to have a series expansion of thc form 


A =a, d cb d, e, (1) 


where the terms 2,, 22,... are readily computable.! Then we 
have the approximation 


AR A, = d, + Gg cb s + Gy, 


where A, is the nth partial sum of the series (1). The error com- 
mitted in making this approximation is obviously just the sum of 
the omitted terms, i.e., the remainder 


On = anyi + daa bon 


(after n terms). Clearly, «, can be made arbitrarily small for 
sufficiently large n. Our job is to find simple estimates for «,. 
We will then be in a position to determine the value of n for 
which A, approximates A to within any given accuracy. 

If (1) is an alternating series whose successive terms decrease 
in absolute value, i.e., if (1) is a series of the Leibniz type, then the 
remainder «, has the same sign as its first term and a smaller 
absolute value than its first term (Ruds., p. 74). Thus, in this 


1. In fact, the terms a1, a, ... are usually rational numbers. 
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case, we already have at our disposal a technique for estimating 
&,, which leaves nothing to be desired from the standpoint of 
simplicity. The situation is more complicated for a positive 
series. To estimate the error «,, we look for another, easily 
summable positive series whose terms are larger than the cor- 
responding terms of «,. For example, in the case of the series 


~ l 
we have the estimate? 


S 1 c. 1 


= ) —« 


li 
a 
tt 
3 8 
T 
os 
3 
| — 
— 
| 
x |- 
NL 
ll 
x|-— 


Remark. One is ordinarily interested in decimal approxima- 
tions to the number A, although the terms a,, 25, ... rarely turn 
out to be terminating decimals. Thus the "round-off error^ 
committed in writing a, , 25, ... in decimal form must be taken 
into account, as well as the “truncation error” a,. 

Even when the series (1) has simple terms and a remainder 
which is easily estimated, it often fails to be a practical way of 
calculating A, due to its having too slow a rate of convergence. 
In other words, the partial sums 4,, 45, ... may approach their 
limit A too slowly as n > oo. For example, the series 


L 1l 1 

l-> +> ten, 
2 3 4 Q) 
1 1 1] 

1-—+—-—+ 
3 5 7 


converge to In 2 and 2/4, respectively (cf. Problem12, p. 52). 
However, to calculate these numbers to within 1075, we need 
100,000 terms in the first case and 50,000 terms in the second 


2. The same estimate has already been found in Ruds., formula (6), 
p. 45, in connection with the integral test. 
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case! Obviously, such calculations are feasible only with the help 
of a high-speed calculating machine. As will be shown in the next 
section, it is not very hard to find series expansions of z and In 2 
which converge much more rapidly than (2). 


PROBLEM 


Let «, be the remainder after n terms of the series 


o ] 
1+ } — 
m=1 m! 
Prove that 
a, < 
nin 
Hint. Note that 
ee 1 
m=at+i m! — n! m=at+1 (n+ l1): m n! min4i (n + 1)^7" 


12. Examples 


The following examples illustrate the technique of using series 
to make numerical computations: 

Example 1. Find a rapidly convergent series suitable for cal- 
culating zt. 

Solution. Setting x — 1/43 in the expansion 


xi x5 x? 
arc tan x = x — — + > -> +e (-l<x<1) 
3 5 7 
(Ruds., p. 115), we obtain 


m 1 
— = arc tan —— 
6 V3 


_ 1 ji l1li,11 11, 
J3 33 53 7 33 ' 
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which is much more suitable for calculating z than the slowly 
convergent series 


i 


1 
—+ 
4 3 


1 1 
pee, 
5 7 


To get a series which is even more suitable for calculating z, let 


l 
& = arc tan —. 
5 


Then 





10 
= 0 
tan 4a = —À2—— = 12 


1-275 119° 
Since tan 4« is close to 1, it is clear that the angle 4a is close to 
a/4. Setting 





7l 
= 4& — —, 
P 4 
we have 
Hol 1 
tan p = = 
P ]|!4 Hj 239 
so that 


1 
= arc tan —. 
á 239 
It follows that 


z — l6x — 48 


24d 4 a( oL d us. q 
11 5% 239 3 2393 


This series is very rapidly convergent (see Problem 2). 
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Example 2, Find a rapidly convergent series suitable for cal- 
culating In 2. 
Solution, Setting 





in the expansion 


2 4 
In LA Wax fp 424g.) (qp en) 
1—x 3 5 





(Ruds., p. 117), we get 








1 n+l 2 1 1 1 1 + 
n = L o o eee 
n 2n + 1 3 Qn + 1)? 5 Qn + 1)* 


Q) 
(cl. Ruds., p. 124). For n = 1, this gives the rapidly convergent 
series 
2 
m22i( ie tty titan. " 
3 3 9 5 9 


(sce Problem 3). 
Example 3. One way of calculating roots is to use a table of 
logarithms. Another way is to use the binomial series 


m(m — 1) 2 


(+ x)" = 1 + mx + 2i 


m(m-—1)(m—2) , 
3! * 


+ 





+ (xe) @) 


. k 
(Ruds., p. 120). Let a be an approximate value of the root VA, 
where a may be an overestimate or an underestimate. To im- 
Prove this approximation, suppose, say, that 
A 


—=1+x, 
a* 


5 Fichtenholz (2094) 
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where |x| is a small proper fraction. Then 
— A 
VA- as] 4. =a + xt, (5) 
N ak 


and we can use (4) with m = 1/k. Alternatively, it is often more 
convenient to start from the formula 


i 


k 
S 214 x, 
A 


where |x'| is again a small proper fraction. This time 





VA = —E oa + xy, (5) 
E 
k | — 
A 
and we can use (4) with m = —1jk. 


Thus, for example, to sharpen the approximation 


J2 = 1.4, 
we write 


- 1/2 
J= 14 [2-14 fi +24 414 LL 
1.96 1.96 49 
or 


J- l4 1.4 -14(1- 5)" 


[3s J | 0.04 50 
V2 2 


To keep the calculations simple, we naturally prefer the second 
formula, which leads to the rapidly convergent expansion 


Ja-ia(i.e Lu 3 2,54 
250 859 16 50 

35 ] 63 1 

+ — Fee 








+ — — 
128 50* 256 505 
(see Problem 8). 


(6) 
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PROBLEMS 


1. Prove that 


Hint. Choose x = 4, y = 4 in the formula 


x+y 
arc tan x + arctan y = arc tan ————, 
1 — xy 


valid for 


A 
larc tan x + arc tan y| < > 
(explain this condition). 


2. Use formula (1) to calculate z to seven decimal places, mak- 
ing Sure to take round-off error into account. 
Hint. It is enough to compute the terms already written out 


in (1). 
Ans. zt = 3.1415926... 


3. Use formula (3) to calculate In 2 to nine decimal places. 
Hint. Nine terms of the series suffice. In fact, if A is the error 
due to dropping all terms from the tenth on, then 


2/1 1 1 1 
A= > | — — + — — + = 
3 \19 9? 2] 919 


2 1 l 
«———[(1-—-c4-—-- 
3-19-99 9 9? 


1 2 
= ————— < —. 
12-19-98 101° 


Ans. ln 2 = 0.693147180... 
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4. Show that 


15-2124 2 14244131 Q4 (7) 
9 3 81 5 81? 


Hint. Set n = 4 in formula (2). 


5. Using (3) and (7), calculate 





| 1 
^ In10 
to nine decimal places. 
Ans. M = 0.43429448] ... 
Comment, Note that? 
logn = M Inn, 


so that M is the ratio of the common logarithm of any number to 
its natural logarithm. Thus, going over to common logarithms 
in (2) and (3), we get 








n+ 1 2M 
log = 
n 2n + 1 
1 1 1 ] 
x | 1 + ————_ t- ee 
3 (2n + 1)? 5 (2n + 1)* 
(2) 
and 
1 
log2 — 2M. j2ll.,ll,. . (3) 
3 39 5 9? 


6. Use formula (3^) to find log 3 and log 7. 
Hint. Choosen = 80 = 2?- 10, noting thatn + 1 = 81 = 34, 
Then 


4log3 — 3log2— 1 








2M ] ] ] l 
= — |l] + — — tee) 
161 3 25,921 5 25,921? 


3. As always, log n = logio n, Inn = logen. 
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from which log 3 can easily be found (log 2 is already known). 
Next choose n = 2400 = 3:2? - 10?, noting that n + 1 = 2401 
= 74. Then 


4log7 — 3log 2 — log 3 — 2 


_ 2M d 1 ,l l ra 
~ 4801 3 23,049,601 5 23,049,601? ` 


Comment. This technique can be used to find the common 
logarithms of the prime numbers to within any desired accuracy, 
Common logarithms of composite numbers can then be found 
by adding integral multiples ofcommon multiples of prime num- 
bers. For example, 


log 120 = 3 log 2 + log 3 + log 5. 


7. Prove that the error A of the approximation 





2M 
log (n + 1) — logn = 5 


(10? <n < 104) (8) 
+1 


is less than 4 x 10^ 1. 
Hint. Let A be the error of the approximation (8). Then 





AS—2M 11 1 4.1. 1] 4}. 
2n £113 Qn+1)? 5 Qn & 1 


2M 1 1 
< —— | 1 + — + — eee 
3 Qn + 1} | Qn + 1)? Qn + 1)* | 
2M _ 2M 
3 (2n + 1)2n(2n +2) — 24n? 


Comment. Even if all the separate errors have the same sign, 
the use of (8) to calculate logarithms of the numbers 1000 to 
10.000 step by step would lead to a cumulative error of less than 

10* 1 


—— = — x]10*$. 
2- 101° 2 
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However, it is easy to avoid such accumulation of errors by using 
(2^) to calculate a number of "control logarithms." In this way, 
we can achieve much higher accuracy while at the same time re- 
taining the automatic character of formula (8), a feature which is 
very valuable in compiling extensive tables. 


8. Use formula (6) to calculate J 2 to ten decimal places. 
Hint. It is enough to compute the terms already written out in 
(6). If A is the error committed in dropping all subsequent terms, 


then 231 
A < 1.4 ——— [1 + — +— +: 
1024 - 508 50 50? 


231 Q2 
1024 - 505 - 49 101 ' 











Ans. N2 = 1.4142135623... 
Comment. To get an even more accurate value of J2, we can 
start from the formula 


— -172 
J3 = 141 (1 - 2 . 
20 


9. Verify that 


30,000 3 100 

1/3 _ 1/3 
3/93 (14 4)” 3-19 2 
4 125 7 1000 


Use these formulas to get accurate approximations to the roots 
in question, 


13. Euler’s Transformation 


In using a series for approximate calculations, it is sometimes 
useful to subject it to a preliminary transformation. By this we 
mean the use of some rule or other to replace the given series by 
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another series with the same sum, Of course, making such a trans- 
formation is appropriate only when the new series converges 
more rapidly than the old series or is more suitable for calcula- 
tions. 

We now derive the formula for a classical transformation due 
to Euler. Let 


S(x) = Y (-0)*a,x* 
k=0 
= ag — dX + a3x? — + + (— 1l)" apx* + 
(x > 0) (1) 


be a convergent series, where for convenience we write, the Ath 
term in the form (— 1)* a,x* without assuming that all the a, >0. 
For the sequence {a,} we introduce the successive differences 


Ady = dy41 — Gx, A? ak = Aayy, — Ady = d,45 — 20,44 + dx, 
and, in general, 
Ava, = A®~1a,,, — Atak 

= ükep — Cia, + p-1 + Cray 4 p—2 se +(—1) a, (2) 
where C? is the binomial coefficient 


c3 = P 


Jo-j 


We then write the series (1) in the form 





S(x) = ao _ 1X 7 dox 
1+x 1+x 
2 2 3 3 
ü2X* — ax Q3X — AX 
FEM 2023 000 7X eee. (3) 


l+x l+x 
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This is permissible since the (k + 1)th partial sum of the new 
series differs from the kth sum of (1) only by the term 


1 


r " (—1)**! a, ix** !, 
x 





which approaches zero as k — œ because of the convergence of 
the original series (Ruds., Theorem 5, p. 8). 
We now use the differences to simplify (3), obtaining 





S(x) — (ay — Aag +x + Aa, * x? — Aan: x? ++), 


tx 
Retaining the first term, we write the remaining series 


x 
l+x 





(dao — Aa, : x + Aaz: x? — +++) 


like S(x) itself in the form 


x | 


l+x lx 








(Aag — A?as : x + A?a,* x? — +), 


so that, splitting off the first term again, we get 





S(x)-—2.-— _ Ady — x 
1+x (1 + x)? 
x? 
+ ——— (A?ag — A?a, "xc e). 
(1 + x)? 


Continuing in this way, we obtain 





2 
S= — 4% yp £o _ 
l+x (1 +x) (1 + x)? 
p-1 
+ (—10)71 A" tao x?-! 4 Rix) (4) 


(1 + xy 
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after p steps, where 
+) 


(4"agy — A®a,- x + A25 * x? — 


= (— pe A 
Rw) = (“IP Ty 


——— (—1)* A"a,x*. 
e + x) 2, ' 

To prove that R,(x) > O0 as p > œ, we replace the pth difference 
Pa, by its expression (2) and reverse the order of summation, 


= =(— 1)? 


obtaining 
12k + pi 


R(x) = (—1)**» x**»5 (-1) C 
= A X 
CPx i 1 k+p-i a x**5- i 
EET n > L x C ) ktp-—i 
Denoting the remainder of the original series (1) by 
(020,1,2,...), 


r(x) = y (-D**^ a, x**7 


we can finally write R,(x) in the form 


X Cixir,- rD 5 Cix?—'r, (x) 
AOT ux (1 + xP 


and hence R,(x)— 0 as p — oo, by Problem 3, p.25, since 


r(x) > 0 as n — œ. 
Taking the limit as p oo in (4), we get 


2 
ete ( Y = 
l+x 











fas - 4an x 
1+x 


S(x) = 
(5) 


+ (= 1)? Aa, (+) + UB 
l+x 
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Comparing (1) and (5), we finally obtain Euler's transformation 
Soat = y cm4aw(——y. « 
—l*a,xk* = ——— — ü . 
k=0 : l +x p=0 (X) ©) 


Equation (6) is most frequently used with x = 1, and it then 
transforms one numerical series into another: 











—1)k (— 1)? A’ay 
2 Ne =) ee 2P+1 l 0) 
Example 1. Let 
a= 1 
l zt+k’ 
where z is any constant different from 0, —1, —2,... Then the 
series = (1) 
kz0 z+k 


is a series of the Leibniz type if we drop a sufficiently large num- 
ber of initial terms, and hence converges. The successive differ- 
ences ax, A*a,,... are easily calculated. In fact, using mathe- 
matical induction, we find that 


Ara, = (—1)? ——____?* 
(Z+k)(z@+k4+1)--(@+k +p) 


and, in particular, 


Aas = (-19 ———?» 8 
7 Yet) GID ®) 


It follows from (7) and (8) that 
e (-D* <1 p! 
KO z-k 5627 z(z+ 1l) (z +p) 





(9) 


Setting z = 1 in (9) leads to the following transformation of the 
familiar series for In 2: 





In2 — Y (-1p- 


1 
m=1 m n=1 2"n i 
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The second series is obviously more suitable than the first for 
numerical calculations. In fact, to get an accuracy of 0.01 we 
need 99 terms of the first sequence and only 5 terms of the sec- 
ond! 
Example 2. Lei 
_ 1 
og + 2k’ 





where 2 is a constant different from 0, —2, —4, ... Representing 
a, in the form 


— 





we can use formula (8) to write 
1 
Aao = (— 1)? — 


27+ 1p! 


= (=p P. 
2 z(z + 2)-- (z + 2p) 


(10) 


Then Euler's transformation (7) takes the form 





-15 — —— (11) 
2 szo z(z-2)-(z-2p) 


Setting z = 1 in (11)leads to the following transformation of the 
familiar series for 2/4 (Ruds., p. 115): 


n kad 1 1&6 p! 
Ž o2y(-]y = 
4 Xf) %wk+1 25 2, o (2p + 1) (2p — D--3 





Example 3. In calculations using a transformation of a series, 
it is often convenient to first calculate some terms of the series 
directly and afterwards subject only the remainder of the series 
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to the transformation. As an illustration, suppose we calculate zz 
by using the series 





1 1:2  1-2:3 
w= 2{1 + — +— + +o 
3. 3.5 3-5-7 
dep 
+), (12) 
33-0p eb 


derived in the preceding example. Since the ratio of the last 
written term to the preceding term is 


p el, 
2p +1 2 





the discarded remainder of the series is always less than the pre- 

ceding calculated term. For example, we get z to six decimal 

places by calculating 21 terms of the series (12), since 
]:2-:3...20 
1:3- 5-41 


— 0.00000037... « 0.0000005. 


However, if we calculate the first 7 terms, say, of the original 
series directly and transform only the remainder after 7 terms, 


we get 
a-4(1- l.l. 1,1 1, 
3 5 9 


l 
7 
1 1:2 
-2( L4 +—— +— 2 _ 4 
«(I5 15-17 15:17:19 


1-2 
ee fe 
15-17-- (15 + 2p) ) 


The eighth term of the transformed series is now within the 
required limits, since 
2 1-2-3-4-5-6-7 
15-17-29 


= 0.0000002... 
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Hence to get the same accuracy as before, we must now only 
calculate 8 more terms besides the 7 retained terms, i.e. only 
15 terms in all as opposed to the previous 21 terms! 


PROBLEMS 


1. Prove that 


= 1 
arctanx = —]y————- x?k*1 
2s ) 2k --1 











_ x y 2p (2p — 2). 4:2 x? WV 
1 + x? »=0 (2p + 1)(2p — 1)---3-1 


(cf. Ruds., p. 115). 
Hint. Choose a, = 1/(2k + 1) in (6), using (10) with z = 1 to 
calculate A?a, . 


2. Give examples showing that subjecting a convergent series 
to Euler's transformation does not always improve its rate of 
convergence. 

Comment, In comparing the rate of convergence of two series 


with terms of arbitrary sign, we start from the behavior of the 
ratio of the corresponding remainders y, and yp, i.e., if 
Ivalya| > O as n — oo, we say that the first series converges more 
rapidly than the second and the second more slowly than the first 
(cf. Ruds., Definition 1, p. 53). 

Ans. The series 


UC D 2* 
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is transformed into the more rapidly convergent series 
while the series 


is transformed into the more slowly convergent series 
y 1 /3\? 
v=0 2 (4) — 


14. The Transformations of Kummer and Markov 


We have just seen how Euler’s transformation, based on a 
well-defined rule, leads to a unique transformed series, which, 
however, is not always suitable for computational purposes (see 
Problem2 above). We now describe a method of transforming 
series due to Kummer which has a high degree of built-in arbitra- 
riness (requiring much ingenuity on the part of the calculator), 
but which in return is more specifically directed to the goal of 
simplifying the given calculation. 

Thus let 

AO 4 AO 40 4 ACO sus (1) 


be a convergent series, and suppose we want to calculate the sum 
of (1) to a given accuracy. Clearly A“ — 0 as k — oo. Suppose 
we find another series 


at? + aD per tat. (2) 


converging to an easily calculable finite sum A, such that the 
general terms A™ and a of the series (1) and (2) are equivalent, 


indicated by writing A® ~ a} (as k > oc), in the sense that 





lim —— = 0, (3) 


Computations Involving Series 79 


where 
k k k 4 
at ) = A‘ )— at ) ( ) 


Formula (3) is usually written more concisely as 








(k) k 
ai^ = o(4®). (5) 
Note that (5) implies 
o (k) 
X, o(a; ) 
as well, since 
k 
at 
k k 
tk) at ) . AO 
lim d d$ 7 lim m= 0 
ko a, ka A” x ka Oy 
Am 


It follows from (4) that 


X Amo Y aa x aP-A tla O 
k=1 k k=1 
Thus we have reduced the calculation of the sum of the original 
series (1) to that of the sum of a transformed series whose terms 
certainly approach zero more rapidly than A“, because of (5). 
Example. To calculate the sum of the series 


= ] 
are 
we recall that 
z 1 
OUTES 
(Ruds., Prob.2, p. 4). Since 
1 1 1 
im KE + Digg PFD S 
kaw k>a@ 


k? k 
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it follows from (6) that 


yl-i. I 


ka k? 2 k? (k 1) 0) 


where the transformed series is clearly more suitable for cal- 
culation than the original series. 

Repeating the same process, suppose we can find still another 
series 


(1) (2) 


(k) 
5; + az 


DE + az Moe 


converging to an easily calculable finite sum A, such that af? is 


equivalent to «f? in the indicated sense. Then 
a a 
YAM =A, + A4, 4 Y at, 
k=1 k=1 


so that the calculation of the sum of the original series (1) reduces 
to that of the sum of a series whose terms 


k k (k k 
a? = af — al = ofa 


converge to zero more rapidly than «?. Similarly, repeating the 


process p times, we arrive at the formula 


Y AM = Ay + Ag te +A, t Y D, (8) 
ktA km1 
where 


a 
Aj-YaP (i=1,2,...,p) 
kml 

are known sums of series which are successively “split off” from 
the original series, so that the problem reduces to calculating the 
sum of the series in the right-hand side of (8). 

Next we discuss another method, due to Markov, for trans- 
forming a given convergent series 


a 


) 49 =A. (9) 


k=1 
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Like Kummer's method, this method also has much built-in 
arbitrariness. 

Suppose every term of (9) can be represented as the sum of a 
convergent series 


AO —Y d?  (k-1,2,..), (10) 
J=1 


and consider the infinite rectangular matrix 





1 (1) 01) 201) (1) 
AO | aj! a?" a3 eye 


2 2 2 2 
AD | aP a a... at... 
3 3 3 
AD | aP a a... a... 
(11) 
k () UO | UO k) 
AO | ay? ay asy + G; 


made up of the terms of the series (10). Then the number A is 
just the sum of the iterated series 


ao a 
A= yap 
k=1J=1 


corresponding to this matrix. Assuming that every column of the 
matrix gives a convergent series 


ao 

(k) 
$a; = A), 
k=1 


Markov established a necessary and sufficient condition for the 
series 


È Aj 
4-21 


to converge to the same sum A. Correspondingly, Markov's 
transformation consists in replacing the original iterated series 


$ Fichtenholz (2094) 
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(summed over rows) by the other iterated series (summed over 
columns): 
A= y AC = X A;. 
k=1 


A sufficient condition for applying Markov’s transformation is 
given by Theorem 3, p. 34, say. However, the theorem proved 
by Markov is much more general, and does not even assume the 
absolute convergence of the series involved. 


PROBLEMS 


1. Prove that x, ~ B, (as k > oo) if and only if 


lim = = 1 

k— a By 
2. Show that 
Y l- DL 2 L1 4 
k=1 k? 2? k=1 k? (k + 1) (k + 2) 
Pllielalaa looi 000 
kei k? 2 m k=1 k? (k + 1) (k + 2) (k + 3) 
and more generally, that 

Lipt pnp p X Ld 5. 

k=1 k? 2? p? ket k? (k + 1) --- (k + p) 


(12) 
Hint. Starting from (7), use (8) and the formula 
z 1 1 
Y LA 
k=1 k(k +1) (k +p) p:p! 
(Ruds., Prob. 2, p. 4). 
Comment. Thus the calculation of the sum of the slowly 
converging series 


ims 


l 
1k? 
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is reduced to the calculation of the sum of p of its terms and the 
sum of a transformed series which converges rapidly (even for 
moderate values of p). 


3. Show that 


œ% ! 
yl.s 1, 1 1, 2! 
2 2-23 3-235-3-1 
1 (p — 1)! 
p:2?Qp—-1)Qp—3)-3:1 
(py 
2° (2p —1)0p—3)-- 3-1 
x Y ——__! 
xci k? (k + 1)? --- (k + py 














x 


(13) 


Hint. Since 


1 kty 
k+1l+y 
(kd *(k- 2)? (k — 
1 | 
2p — l| K&? (k + 1? --- (k +p — 1)? (k + py 
I 





as k — oo, where y is temporarily undetermined, it follows from 
(6) that 
c 1 1 l-y 


&, k? (k + 1)?--(k+p—1)? 2p—1 (pY 


2 
2 [»-; Po een - zu 
4X PO EP 


Ke k? (k + 1)? (k + py 








p= 
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Now choose 
_ 3P 


2 


thereby causing the term containing & to vanish in the numerator 
of the series on the right. With this choice of p, 














3 3 
S= ———P + ? Sa 
20p- 1)(p)? 2Qp-1) 
Therefore 
=~ l 3 l 
— =S,;=—+—S,, 
à p ! 2 2 2 
na 
l s, = 3 1 (2!) . 
2 2-27 3 2?.3.] 
(p — D! 
2°~1 (2p — 3) (2p — 5)-- 3-1 ” 
| 3 (p — 1)! 
p:22Qp-)Qp—3)-3:1 
!y 
(p?) S51; 


2? (2p — 1) (2p — 3)-- 3:1 
which together imply (13). 
4. Suppose we choose p = 5in (13) and also retain 5 terms of 


the transformed series. What is the accuracy of the resulting cal- 
culation of the sum of the original series? 


5. Interpret Example 3, p. 44 as an instance of Markov's 
transformation, discussing the results of using the two represen- 
tations 


1 
(k k k) 
— =a P tate +a, d rs 
k? 
1 c 
A) 
L2 m » a; , 
k j=1 
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where 





"M (k — 1)! 
aj — 7. : . 
jG t I)e Kk) 
Comment. As already noted on p. 45, Markov's transforma- 


tion gives nothing new if we use the second representation. 


6. Show the connection between Kummer's transformation 
and Markov's transformation. 
Hint. Take the limit as p — oo in formula (8), assuming that 


lim Y, at? = 0. (14) 


pow k=1 


7. Verify that (14) holds in the case of the expansion (13), 
thereby proving that 


z ] ] ! 
ee ee 

















Ei k? 2 2-22 3-25-3-] 
1 0-D —  ,. 
p: 2Qp—)Qp—3--3:1 
oo — ! 
=3) l — @-D!  . (15) 


pai p: 2? (2p — 1) (2p — 3) 3-1 


Hint. The sum in the last term in the right-hand side of (13) 
does not exceed 
1 8] 
(yim ke 





and hence the whole term does not exceed the quantity 


p! y 


2 (2p — 1) (2p — 3--3- 14 k?’ 


which obviously approaches zero as p > oo. 
Comment. Note that (15) is equivalent to formula (5), p. 46. 
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8. Give an example showing that taking the limit (14) does not 
always lead to a useful result. 

Hint. Taking the limit as p — oo in (12) merely gives the iden- 
tity 


Comment. Thus Markov's method is a very general technique 
offering the calculator many possibilities but requiring much 
ingenuity on his part. 


CHAPTER 4 


Summation of Divergent Series 


15. Introduction 


So far, we have defined the sum A of a given numerical series 


ao 
Yay = Ag + ay + dg bons + dy ben (1) 


nm 0 


as the /imit 
A — lim A, (2) 


n-»a 


of its partial sums 
A, = dg + dy + 04 bes + d, 


assuming that this limit exists and is finite or equal to +00. On 
the other hand, the sum of an "oscillating" divergent series, for 
which the limit (2) fails to exist, has not been defined, and we 
have systematically avoided such series. In the second half of 
the nineteenth century, however, consideration of various situa- 
tions encountered in mathematical analysis, such as the fact that 
the product of two convergent series can diverge (see Example 1, 
P. 27), naturally brought to the fore the problem of trying to 
sum divergent series in some appropriate new sense, perforce 
different from the usual sense associated with formula (2). 
Certain of these "summation" methods (to be studied in detail 
below) turned out to be particularly fruitful. 

It should be pointed out that divergent series were quite often 
€ncountered in mathematical practice prior to the creation by 
Cauchy of a rigorous theory of infinite series, based in turn on a 


87 
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rigorous theory of limits. Although the use of divergent series in 
proofs was disputed, nevertheless attempts were sometimes made 
to assign numerical values to such series. For example, the num- 
ber 4 was assigned to the oscillating series 


1-141-141-1-4-- 


even in Leibniz's time, a choice which Euler justified by observ- 
ing that the expansion 





l =1l—x+x? — x3 txa 4 
1+x 
(which is actually valid only for |x| < 1) becomes 
1 


-=1-1+1—-1+1-14++ 
2 


if x is formally set equal to 1. There was a kernel of truth in this 
observation, but the whole approach lacked clarity. For example 
one could equally well deduce the formula 
3 2152141-141-21014- 
2 
by setting x — 1 in the expansion 
l+x  1-»x 


— = =] = x? + x3 — x5 4 xÉ — x8 Ho. 
l+x+x% 1—x3 





The whole problem is posed differently in modern analysis. 
The starting point of all discussion is some precisely stated de- 
finition of the “generalized sum" of a series, which is applicable 
to a whole class of numerical series rather than being contrived 
for a particular series of interest at the moment. The legitimacy 
of this approach cannot be contested. The reader need only re- 
call that even the ordinary concept of the “sum of a series,” 
as simple and natural as it may seem, was introduced on the 
basis of a tentative definition, subsequently justified only by its 
expediency! However, regardless of how such a "generalized 
sum" is defined, itis usually required to satisfy the following two 
conditions: 
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1) If the series 


is assigned the generalized sum B, then the series 


Y (pa, + qb,), 

n=1 
where p and q are arbitrary constants, must be assigned the 
generalized sum pA + qB. A method of summation satisfying 
this condition is said to be linear. 


2) The new definition of summation must include the ordinary 
definition as a special case. More exactly, a series which con- 
verges to the sum A in the ordinary sense must have a general- 
ized sum, and this sum must also equal A. A method of summa- 
tion satisfying this condition is said to be regular. 


Naturally, we are only interested in regular methods of sum- 
mation which allow us to sum a larger class of series than can be 
summed by the ordinary method of summation, since only in 
this case does it actually make sense to talk about "generalized 
summation." 

The next few sections are devoted to two methods of gener- 
alized summation of particular importance in the applications. 


PROBLEM 


Justify writing 
m 


—21-141-141-14-;, 
n 


where m and n are arbitrary positive integers. 
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Hint. Note that 


Lt xter tam lax 


+t tort poe! 


16. The Method of Power Series 


First we consider the method of power series, primarily due to 
Poisson who applied it to the study of trigonometric series. 
DEFINITION. Given a numerical series 


È an= Ao +a, td; o ba bs 


n=O 


suppose the associated power series 
a 


Y, ax" = ao + a,x + gx? bos + ax" es 


n=O 


converges for all 0 < x < 1 to a sum function f(x), and suppose 
that 


lim f(x) = A. 


x~1- 


Then the number A is called the generalized sum (in the sense of 
Poisson) of the given series. 
Example 1. As already noted on p. 88, the series 


1—-1-c4-1-1-41-1-4-- 
has the generalized sum 3 in the sense of Poisson, since 


1 
l+x 





l-xtx?—-xe¢x*—-x8 te = 


and 
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Example 2. Use the method of power series to sum the diver- 
gent series 
st y. cos n6 (-x < 8 <x) (1) 
n=1 


(see Problem 1). 
Solution. Form the power series 


= + Y xt eos nd (0 « x « 1), 
n=1 


whose sum is easily seen to be! 


1 1 — x? 
————— —Àá: (2) 
2 1—2xcos6+x 
But 
1 1 — x? 


eu 2 1 — 2x cos 0 + x? 


if 6 # 0. Hence the generalized sum of the series (1) equals 0 if 
8 + 0. If 0 = O, (2) reduces to 





which approaches + oo as x > 1 —. Hence (1) has the generalized 
sum +œ% if @ = 0, Note that (1) obviously has the ordinary sum 
+o if 0 = 0. 

It is immediately clear that the present method of generalized 
summation is linear. Its regularity is a consequence of the follow- 


1. In fact, multiplying 
1-2Z»x'cosn8 


nl 
by 1 — 2x cos 0 + x? and noting that 
2 cos nx cos x = cos (n + 1) x + cos (n — 1) x, 


we get 1 — x? after cancelling terms. 
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ing theorem, proved by Abel in his investigations on the theory 
of the binomial series. Accordingly, the method of power series 
will henceforth be called the Poisson- Abel method (of summa- 
tion).? 

THEOREM | (Abel). If the series 


converges to A (in the ordinary sense}, then the power series 
a 
È ax" 3) 
n=0 


converges for 0 < x < 1 and its sum approaches A as x 2 1—. 

Proof. First we note that the radius of convergence of the 
series (3) is no less than 1 (Ruds., p. 68), and hence (1) actually 
converges for 0 « x « 1. Consider the identity 


e 


$ ax" = (1 — x) Y Aux", (4) 


where 
A, — dg Fd, +... + @ 


(see Prob. 3, p. 83 or Ruds., Prob. 1, p. 85). Subtracting (4) term 
by term from the obvious identity 


A=(1—x)¥ Ax, 


we get 


oc 


A— Y a,x" = (1 — x) F, a", (5) 


n=0 


2. There is no doubt that the general formulation of the method of power 
series, used by Poisson only in a special case, stems from Abel’s theorem. 
The Poisson-Abel method is often simply called Abel’s method, although 
Abel himself regarded the idea of "summing" a divcrgent series as very 
much of an oddity. 
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where «, = A — A,. Since x, — 0 as n > œ, given any e > 0, 
we can find an integer N > 0 such that |x,| < efor all n > N. 
The right-hand side of (5) is the sum of the two expressions 


(-9Y»x^ 0-9) w^ O 


the second of which can be estimated at once (independently 
of x): 
(l—x) } «xx 
n=N4+1 





«(1-» l| x" 
n=N+1 

«s(1— x) Y x" <e. (7) 
n=N+1 


As for the first of the expressions (6), it approaches zero as 
x — 1—, and hence 


la — x) Y, ox" 





<E (8) 


for x sufficiently near 1. Combining (7) and (8), we finally get 


a 


A— ¥ a,x" 


n=1 


<2. E 








We have already seen that even if the series 
Y a, (9) 


is Poisson-Abel summable with sum A, it need not have a sum 
in the ordinary sense. In other words, the existence of the limit 


lim Y a,x" = A (10) 
x1— n=O 
does not in general imply the convergence of (9). The question 
naturally arises of what extra conditions must be imposed on the 
terms of (9) to make (10) imply the convergence of (9), so that 
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(9) has the sum A in the ordinary sense. The first result along 
these lines is the following theorem due to Tauber: 
THEOREM 2 (Tauber). Suppose the series 


a 


X a,x" 


n=0 
converges for < x < l and satisfies (10). Moreover, suppose the 
terms of the series (9) are such that 


. a, + 2a, + -- + na, 
lim = 


n>a n 


=0. (11) 
Then 


Proof. The proof will be carried out in two steps. First we 


assume that? 
lim na, = 0, (12) 


nda 


or equivalently 


Thus if 
n = max |ka,l, 
kzn 


then ó, decreases monotonically to zero as n — oo. Given any 
integer N 0, we have 


L an — A= Y a(1 — x") — b ant + (È ant” - A), 


and hence 


X, a, -|< X Ina, (1 — x) + X MET. 


-4 


= d 


n=0 








ee eee 
(N+ 1)C1— x) 





3. Note that (12) implies (11), by Corollary 2, p. 23, but not conversely, 
so that we are first proving the theorem under a stronger hypothesisthan (11). 
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where we use the inequalities 


1—x'—(1-—x)(1- xc x74 +27") <n (1 — x), 


a xN*1 1 








valid for 0 < x < 1. Choosinge > Oarbitrarily small, we set 
(l-x)N=e, 


or equivalently 
x=1- = 
N 
so that x 2 1 as N > œ. Now let N be so large that dy,, < &? 
and the corresponding value of x is close enough to 1 to make 


a 


Y a,x" — A 


n=0 ] 


« E. 








Then 





N 
Y a, -4| < (2+ bo) £, 
n=0 


which, because of the arbitrariness of Nand e, proves the theor- 
em under the hypothesis (12). 
We now reduce the more general case of the theorem to the 
special case just considered. Let 
Ug = 0, 


Uy = 0, + 2a, +++ + na, (n > 1), 


so that 1 
a, = — (Va — t,-1) (n 2 1) 
n 
and hence 
a a Un a Un—1 
Sax" aye yet 
n=0 n=1 Nn n=1 n 
v Us = Ü, 
=a) -(1— x) Y, — x + Y ———x". (13) 
n=1 n azı n (n + 1) 
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This time we have (11) or, equivalently, z,/n — 0 as n — oo. It 
follows that 
lin (1 — x) Y, x= 0. (14) 


x1-— n=1 H 


To see this, we write 


a N . ac 
0-9Y -x2-ü0-2y-r.ü0-x y y, 
n=1 n a=1 nh n=N+1 n 
and then choose N so large that all the factors v,/n in the second 
expression on the right have absolute values less than some 
preassigned number £ > 0. Then the second expression is itself 
less than e, regardless of x. Moreover, the first expression on the 
right, which contains only a finite number of terms, can also be 
made less than £, by simply choosing x close enough to 1. 
Thus, finally, combining (10), (13) and (14), we get 


. c v 
lim — 7 xt! = 4 — ag. 
x>1-— 2. n (n + 1) ° 


But here we can apply the already proved special case of the 
theorem, obtaining 


a Un 








Y — = A — ag. 
n-1 (n + 1) 
On the other hand, we have 
y Moe tn cU c Us mrt opua 
a=in(n +1) sin acin-kl main azi n 
Vm m 
-— +9) a, 


Since the first term on the right approaches zero as m — oo, it 
follows that 


lm 3a,—A4-—a. M 


md n-i 
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Remark. Subsequently, various authors have proved a whole 
series of delicate theorems of the same type (customarily called 
“Tauberian theorems’’), modifying and extending Tauber's con- 
ditions. 


PROBLEMS 
1. Show that the series 
1 ac 
— + ) cos n6 
2 n=1 


diverges for all 6 in the interval [~ x, zr]. 

Hint. If 6/2 is a rational number, i.e., of the form p/q where p 
and q > 0 are integers, then cos nÜ = +1 for values of n which 
are multiples of g. This violates the necessary condition for con- 
vergence of a series (Ruds., Theorem 5, p. 8). If the ratio 6/x 
is irrational, then, expanding 6/7 as an infinite continued frac- 
tion, we find that* 








for appropriate rational numbers m/n, and hence 


z 
Inü — mz| < —. 
n 


Therefore, for infinitely many values of n, we have 


7 
[cos n0 + 1| < =, 
n 
so that 
a 


|cosn6| > 1 — —, 
n 


which again violates the necessary condition for convergence. 





4. See A. Y. Khinchin, Continued Fractions, third edition, University of 
Chicago Press (1964), p.17. 


7 Fichtenholz (2094) 
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2. Find the generalized sum A(@) in the sense of Poisson of the 
series 


$ sin n8 (—z <S 0 x n). (15) 
n=1 
Hint. 
$ x sinnô = _ xs — 
nzi 1 — 2x sin 8 + x? 
Ans. 
[° if 0=0, 
A(8) = | 1 0 


— cot — if 0 £0. 
2 2 





3. Show that the series (15) diverges for all 0 in the interval 
[—z2, z] except 6 = 0, +z. 


17. The Method of Arithmetic Means 


Next we consider the method of arithmetic means. This method 
of generalized summation, the idea of which is due to Frobenius 
in its simplest form, is usually associated with the name of 
Cesaro who developed the method further. 

DEFINITION. Let 
_ Ag + Ay x o Ao t Art tA 


2 ` n 


žo = Ág, æi 


be the successive arithmetic means of the partial sums 
Á,— dg bd, +t +a, (n = 0,1, 2,...) 


of a given numerical series 


a 
X â, = üg +a, bos +a d rs, 
n=0 
and suppose that 
lim «, = A. 


an> 
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Then the number A is called the generalized sum (in the sense of 
Cesaro) of the given series. 
Example I, In the case of the series 


1-1+1—-1+1—-1+-:., 
we have 
k+1 


~ 2k +1? 





ox X3k—1 


1 
"B 
Hence x, — 4 as n > oo, and we get the same sum as by the 
Poisson-Abel method (Example 1, p. 90). 
Example 2. The series 


cos nB (—z «€ 0 « x) (1) 


a 
=1 


1 
—+ 
2 n 


has partial sums 1 
sin ( + ;) 8 
A, = ————— (6 x 0) 


2 sin — 
2 


(see Ruds., formula (8), p. 82). The arithmetic means are easily 
calculated. In fact, 





(n + l)a, = l 5 Y sin(ms 1)o 


2sin— "7° 
1 n 

= ———— Y [cos m8 — cos (m + 1) 6] 
4sin? — "^? 


| l-cos(n1)80 1 
4 sin? Ê 2 sin — 
2 
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and hence 
6 2 
sin (n + 1) — 
1 ( ) 2 


2 (n 1) 








sin — 


Obviously «, — 0 as n > oo, so that the generalized sum of the 
series (1) in the sense of Cesàro equals 0 if 0 # 0. Thus we get 
the same result as obtained by the Poisson-Abel method 
(Example 2, p. 91). This is no coincidence, as will be shown in 
a moment (see Theorem 1 below). 

The fact that the method of summation by arithmetic means 
( Cesáro's method) is linear is obvious from the definition. More- 
over, if the limit 

lim A, 


na 


exists and equals A, then 


lim «, = A 
as well, by Corollary 2, p. 23. It follows that Cesaro’s method is 
also regular. 
Lemma. If the series 


is summable by the method of arithmetic means to a finite "sum" 
A, then 





a, = o(n). 
Proof. Since 
æAn-1 > A, nt | 4 
n 


as n — oo, we have 


(n + l)«,—nx,., An 








n n 
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and hence 
d, A, n — l Anı 
=Z = 2 _ —__ 30 
n n n n—l 
asn> o. B 
We can now give a definitive answer to the question of the 
connection between the Poisson-Abel method of summation and 
Cesàro's method: 
THEOREM | (Frobenius). If the series 


a 
) an 
n=0 


is summable by the method of arithmetic means to a finite "sum" 
A, then it is also summable by the Poisson—Abel method to the 
same sum A. 

Proof. By hypothesis, x, > A asn — oo. Then the power series 


f(x) = 2 ar" 


clearly converges for 0 < x < 1, by the lemma. Applying 
Abel’s transformation twice (as in Prob.3, p.17 or Ruds., 
Prob. 1, p. 85), we get 


f(x) 2 0 — x) Y A,x" = (1— x}? y (n + l)e,x. (2) 
But, as is easily verified, 


U “> = X 1) x" 


or 
a 


1=(1-— x?) (n+ 1x (3) 


for 0 < x < 1. Multiplying both sides of (3) by A and then 
Subtracting (2) term by term from the resulting identity, we get 


A — f(x) = (1 — x)? 2 (n + 1) (4 — «,) x". 
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The right-hand side is the sum of the two expressions 


Q- x)? ) (n + 1)(A-«,)x", (1 -3 JY (n + 1)(4 — an) x". 
(4) 


Let N be so large that |A — o,| < e for all n > N, where e is 
any preassigned positive number. Then the second of the ex- 
pressions (4) is itself less than € is absolute value (independently 
of x), while the first expression can also be made less than « is 
absolute value by simply choosing x close enough to 1.5 

Thus we have shown that whenever Cesàro's method is ap- 
plicable, the Poisson- Abel method is also applicable and leads 
to the same generalized sum. The converse is not true, i.e., there 
exist series summable by the Poisson- Abel method but not by 
Cesaro’s method. For example, the series 


1-243-44- (5) 


cannot be summed by Cesàro's method, since the necessary con- 
dition a, = o(n) proved in the lemma obviously fails. On the 
other hand, the power series 


1 — 2x + 3x? — Ax? 4 (0<x< 1) 


has the sum 1 


(1 + x)? 


which approaches 4 as x > 1—, so that (5) is summable to 4 by 
the Poisson-Abel method. Thus the Poisson-Abel method is 
more powerful (i.e., applicable to a larger class of series) than 
Cesaro’s method, but leads to the same result as Cesaro’s 
method whenever both methods arc applicable. 

Just as in the case of the Poisson-Abel method, we can prove 
theorems of a "Tauberian" type for Cesaro’s method, establish- 


5. Note the resemblance between the proof of this theorem and Theo- 
rem 1, p. 92. 
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ing extra conditions on the terms of a series under which the 
summation of the series by Cesaro’s method implies its conver- 
gence in the ordinary sense. Because of Frobenius' theorem, it is 
clear that every Tauberian theorem for the Poisson- Abel method 
leads to an analogous theorem for Cesaro’s method. For exam- 
ple, Tauber's theorem itself (Theorem 2, p. 94) can be para- 
phrased as follows: Ifa, — A and 


lim 41. * 242 t tna _ og (5) 


nca n 
then A, — A. Here, however, the theorem is an immediate con- 
sequence of the easily verified identity 
Qa, + 2a; + + na, 
A, — æA, = 


n+l 


which in the present case even implies the necessity of (6). 

It was proved by Hardy that x, — A implies A, — A not only 
if a, = o (ljn) (this case is contained in the foregoing) but also 
under the weaker assumption that 

|man| < C (m = 1, 2,...) (7) 
for some constant C > 0. Then Landau showed that (7) can 
even be replaced by the corresponding “one-sided” inequality: 

THEOREM 2 (Hardy-Landau). Zf the series 


a 


È an 


n-o 
is summable to A by the method of arithmetic means and if 
ma, > —C (m = 1,2, ...) 


6. Note that 
(a +1) A, — (n + 1) Oty = (n + 1) A, — (Ao + At t cn + An) 
= (An — Ap) + (An — A1) + c7 + (An — An-1) 
= (ay + az + c: + a) + (a2 c + an) 
+ + Gy 
=a, + 2a, + + na. 
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for some constant C > 0, then? 


Proof. First consider the sum 


ntk 


S= Y An, 


m=n+1 


where n and k are arbitrary positive integers. This sum is easily 
transformed into 


nk n 
S= Y A,— Y A, (nt kt l)e. — (n l)a 
m=0 m=0 
= ke... + (n + D (x, — On)- (8) 


It follows from the hypothesis 


C 
a, > -~ 
m 


that any Am (with n < m <n + k) has the following lower 
bound: 


Am = An (aua to a)» An EC. 
n 


Then, summing over m, we find that 


2 
s>ka,-“c. 
n 


7. Changing the sign of all the terms of the series, we see that it is also 
sufficient to assume the opposite inequality 
ma, < C (m = 1,2,...). 


In particular, the theorem is obviously applicable to all series with terms of 
constant sign. 
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Comparing this with (8), we find that 


n+ 1 





An € Onin + (one = On) + k C. (9) 
n 


Now let n approach infinity while at the same time k is subject to 
the requirement that the ratio k/n approach a preassigned posi- 
tive number e. Then the right-hand side of (9) approaches the 
limit A + eC, so that 


A, < A + 2:C (10) 


for all sufficiently large n. 
In just the same way, by considering the sum 


S= Y Ag = kän- (n (o, — o.) 


m=n-k+1 


and deducing the upper bound 











Am = A, — (Qm+1 + + an) < A, + C 
n — 
for A,,, we arrive at the inequality 
2 
S' < kA, + k C. 
n — 
lt follows that 
An > Onn + n+ 1 k 


(a, — Anr- — —— C. 11) 
9- ( 
lfn > œ and at the same time k/n > e, then as before (but this 
time lete < 4), the right-hand side of (11) approaches the limit 


A -— E 





C » A — 2C, 


l-e 
so that 
A, > A — 2eC (12) 
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for all sufficiently large n. Comparing (10) and (12), we finally 


Bet 


Remark. A similar Tauberian theorem has since been proved 
for Poisson-Abel summation, with the Hardy-Landau theorem 
as a special case. Because of the complexity of its proof, this 
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lim 4,— A. E 


nm 


more general theorem will not be given here. 


1. Use the method of arithmetic means to sum the series 


PROBLEMS 


sinnô (~a € 0 <2). 


Compare the result with Problem 2, p. 98. 


Hint. Since 


(n + 1) æ, 








n (8 # 0) 
2 sin — 
2 
(see Ruds., formula (7), p. 8), we have 
n+1 6 1 
= > cot z oe x 
4 sin? — 
2 
ntl 
x J, [sin (m + 1) 0 — sin m6] 
m=1 
"tl oa? _ Sin (n + 2) 6 — sin 6 
2 2 ` 


4 sin? 6 
2 
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It follows that 


limo, = + cot ^. (6 0). 
2 2 


n+ 


2. Prove formula (2) directly. 
Ans. 


(1 — 2x + x?) y (n + l)a,x" 


= y [(n + 1) a, — 2nx,., + (n — 1)o,.,]»" 


n=O 


- Y (fn Do, — nal — [nsa — (n — Wana] 


n=O 


= Y (Ay — Agua) x" = PED 


n=0 


where the series on the left converges by the boundedness of the 
&, and we set x, = «%., = A_, = 0 (the convergence of the 
last series is automatic here). 


3. Let {a,} be a positive sequence decreasing monotonically 
to zero, and let 


Ag = do, A,— dg t d, +e +a, (n > 0). 
Prove that the alternating series 
Ag — Ay + Ap — Ag b ee (13) 


is summable by Cesàro's method and that its generalized sum 
equals one half the sum « of the convergent series 


dy — d, + Ag — da + 


of the Leibniz type. 
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Hint. The arithmetic mean of the first 2m partial sums of (13) 
can be written in the form 


l (ao —ai)-- (ao — a1 + 28-27 d2m- 1) 





2 m 


and hence approaches 4« by Corollary 2, p. 23. Show that the 
arithmetic mean of the first 2m + 1 partial sums of (13) ap- 
proaches the same limit. 


4. Show that the divergent series 


H, — Ha + Ha — H4, 
where 1 1 
H,=1+—+--+-, 
2 n 
is summable by Cesaro’s method to 4 In 2. 


Hint. Use the preceding problem with 





a, = (n = 0, 1, 2,...). 


n+ 1 
5. Show that the divergent series 
In 2 — In3 + In4 — In5 + 


is summable by Cesàro's method to J In (7/2). 
Hint. Use Problem 3 with 





(n = 0,1, 2,...), 


recalling Wallis’ product (Ruds., Prob.1, p. 91). 


6. Use Problem 3 to prove that the divergent Dirichlet series 





(-l<x<0, §=-x,0<£< 1) 


(cf. Ruds., Example 2, p. 82) is summable by Cesàro's method. 
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Hint. Writing n* as the sum 
ni = (1-0) + =I += + (nF — (n= 1), 


use differentiation to show that f(n) = m — (n — 1} is a 
decreasing function of n. Then show that f(n) > 0 as n > oc. 


7. Consider the series 
1—1-1—-1-41-—1-4-, (14) 
1—-1+0+1-1+0+1-—-1+0+-.. (15) 
O+1—1+04+1+0+0+0-1+--, (16) 


where (15) differs from (14) by having a zero after every pair of 
terms +1 — 1, while (16) differs from (14) in that the term +1 
in the mth position (m = 0, 1,2, ...) is moved to the 2th posi- 
tion with the remaining positions being filled by zeros. As we 
already know, (14) is summable by Cesàro's method to 4. Show 
that (15) is summable by Cesàro's method to 4, while (16) fails 
to be summable by Cesaro’s method. 

Hint. In the case of the series (16), as n goes from 2?"^! to 
2?" — 1, the arithmetic mean of the first n + 1 partial sums os- 
cillates from 


] 2?" — ] 2 
— => — 
3 22mr1 4. ] 3 
to 
ea 1 
3. 2m 3 


Comment. Separating the terms of a convergent series by 
clusters of zeros has no effect either on the convergence of the 
series or on its sum. This problem shows that the situation is 
quite different in the case of summation of divergent series. 
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18. Application of Generalized Summation to Multiplication 
of Series 


We now apply the method of generalized summation to the 
problem of multiplication of series (Sec.4). Thus, given two 
series 


Ms 
SB 
I 


do ta, te +a, t's (1) 


Ma 
St 
| 


= by + byte + b, bs (2) 

we form the series 

Y C, = Y (aob, + a,b, +e + a, ibi + anbo), (3) 
n=O 


.&, the product of (1) and (2) in Cauchy’s form (see p. 15). 
Even if (1) and (2) converge and have ordinary sums A and B, 
the series (3) may fail to converge (see Example 1, p. 27). How- 
ever, we still have the following 

THEOREM. If the series (1) and (2) converge and have ordinary 
sums A and B, then the series (3) is summable by the Poisson- 
Abel method to the generalized sum AB. 

Proof. The series 


Y aX" = do + a,x te + ax +o (1’) 
n=0 

and 
Y bax” = bo + bix +e + By +e (2’) 
a=0 


both converge absolutely for 0 < x < 1 (Ruds., Lemma, p. 68) to 
sums f(x) and g(x), respectively. Hence the product of (1’) and 
(2^), i.e., the series 


e n 


Y CX” = Y (aob, + a1b, 1 + + au ab, + abo) x" 


a=0 a=0 
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also converges for 0 « x < 1 and has the sum f(x) g(x), by the 
classical Cauchy theorem (p. 14). But 


lim f(x) = A, lim g(x) = B, 


x1-— x1-— 
by Theorem 1, p. 92, and hence 
lim f(x) g(x) = AB, 


x1- 
ie. the generalized sum (in the Poisson-Abel sense) of the 
series (3) actually exists and equals AB. li 

The theorem just proved implies Abel's theorem on the multi- 
plication of series (Theorem 2, p. 29). Moreover, it is clear from 
the proof that the assumption that (1) and (2) converge and have 
ordinary sums A and B can be replaced by the assumption that 
(1) and (2) are summable by the Poisson-Abel method to the 
generalized sums A and B. Recalling Frobenius’ theorem (Theo- 
rem 1, p. 101), we conclude that if the series (1), (2) and (3) are 
summable by Cesdro’s method to generalized sums A, B and C, 
respectively, then 

C = AB. 


Example 1. Consider the series 


Qn — 1) (2n — 3)--3:1 
—]y — — Lope 4 
Fe) 2n Qn — 2): 4-2 t 0 


obtained by setting x = 1 in the binomial expansion 








(2n — D) 2n — 3)-- 3:1 


FOr Qn — 2)- 4-2 


xP ee 
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(Ruds., Prob. 3c, p. 123). Multiplying (4) by itself (see Problem 1), 
we get the familiar series 


1-141-1-41—1-4-;, (5) 


whose generalized sum both in the Poisson-Abel sense and in 
the Cesàro sense equals 


Example 2. “Squaring” the divergent series (5), we get the 
series 
1—243—-445—64-, (6) 


which is Poisson-A bel summable to the sum 


but not Cesàro summable! 


PROBLEMS 


1. Prove that 


e (2m — 1) (2m — 3)--- 3:1 x 
m=0  2m(2m — 2): 4-2 


(2n — 2m — 1) (2n — 2m — 3). 3:1 


=1, 
Qn — 2m) 2n — 2m — 2) 4-2 


where (2m — 1) (2m — 3)---3-1 and 2m (2m — 2)--. 4-2 are 
formally equal to 1 if m = 0. 


2. What is the generalized sum in the Poisson—Abel sense of 
the product of the divergent series (5) and (6)? Write this product. 
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19. Other Methods of Generalized Summation 


We now consider a number of other methods of generalized 
summation, as applied to a given numerical series 


iM a 


ün = lo +a, ++ +a ces (1) 
Q 


with partial sums 
A, — dg +4, os +a. 


1) Voronoi's method. Given a sequence of positive numbers 
{gn}, let 


Qo —4o, Q.—4o t di + tq, (n 0), 
and form the expressions 


= GnAg + Qn—1 4, tcc qon 
Qn 


If w, > A as n > œ, then A is called the “generalized sum” o 
the series (1) in the sense of Voronoi, for the given choice of the 
sequence {q,}. The linearity of Voronoi’s method (and of all the 
other methods considered below) is obvious, and need not be 
discussed further. As for the regularity of the method, we have 

THEOREM 1. A necessary and sufficient condition for regularity 
of Voronoi' s method is that 


Wa 





(n = 0, 1,2,...). 





lim 2". = 0. (2) 
nz Q, 


Proof. First we prove the necessity, assuming that the method 
is regular, i.e., that A, > A always implies w, — A. In particular, 
Choosing the series 


1-140+4+0+04-5, 
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for which A, = 0 and all other A, = 0 (so that A = 0), we get 





Wna = 
Q, 
as n > œ, as required. 
To prove the sufficiency, suppose (2) holds. Let 


as n > œ, while 


y tam = Yu =1. 


m=0 


It follows from Corollary 1, p. 23 that 


lim w, = lim (toMo + t4, +- + t,4,) = lim A4, =A. B 
n> œw n> w n> œ 

2) The generalized Cesàro method. The method of arithmetic 
means encountered in Sec. 17 is the simplest of an infinite family 
of summation methods due to Cesàro. Given a fixed positive 
integer k, let 

yo SO CH Ao + CV A to CEA, 





cute n+k , 
k k 


where as usual C; is the binomial coefficient 


n n! 


m!(n — m)! 


Then the limit of y? as n > oo (provided it exists) is regarded as 


the “generalized sum" (of order k) of the series (1). For k = 1, 
this reduces to the method of arithmetic means. 


Summation of Divergent Series 115 


The generalized Cesaro method is a special kind of regular 
Voronoi method. To see this, we need only set 








_ = ut 1 
since it follows from the formula 
Cc; = Chri + Ch. + CKI Mex... (3) 
(see Problem 1) that 
Qa = Cx’, 
so that 
Qn _ CH 1 B k 50 
QO, cre n+k 
as n oo. 


Using the definition of S“ and the identity (3), we easily find 
that 
sen + Seu Tel SD = So (4) 


where SC? = A,. This allows us to prove 
THEOREM 2. Suppose the series 


>a 

n=O 
is summable to A by the generalized Cesaro method of order 
k — 1. Then the series is also summable to A by the generalized 


Cesáro method of order k (and hence of any order >k). 
Proof. By hypothesis, y^ ? + A as n > œ. But 


uo SD see 1) + sen +--+ sen 











CrU* cite 
cro ive 1) + ck ay 1) peo CH 1 y 1) 
= cutk ? 
k 
because of (4). Using (3) to apply Corollary 1, p. 23, with 
conmk1 
X, = y D tam = HC (m = 0, 1,...,n), 
k 


we find that yj? + 4asn œ. M 
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Next we prove the following natural generalization of Frobe- 
nius' theorem (Theorem 1, p. 101): 
THEOREM 3. If the series 


ngQ 


is summable by the generalized Cesdro method of any order k to a 
finite "sum" A, then it is also summable by the Poisson-Abel 
method to the same sum A. 

Proof. By hypothesis, 





lim yz? = lim ZI =A, (5) 
nd n- oc k 


It is easy to see that the power series 


Sex (6) 
=0 


converges for —1 < x < 1. In fact, since 


m ISI JAI 


If A # 0, then 
lim VIS®] = 1, 


nca 


so that the radius of convergence of the series (6) equals 1, by the 
Cauchy-Hadamard theorem (Ruds., p. 70), while if 4 — O, the 
radius of convergence of (6) is infinite and hence obviously no 
less than 1. 
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Now consider the series of identities 


y a,x" = (1 — x) y A,x" = (1— x) y Sp», 
n-0 n=0 n=0 


ims 


SOx = (1— x) Y Six, (7) 
n=0 


a a 

Y S Dy = a _ x) Y. SO xn 

n=0 n=0 
where we repeatedly make use of formula (4), p. 92 and for- 
mula (4) above. Since the series (6) converges in the interval 


(— 1, 1), so do all the other series in (7). Combining the identi- 
ties (6), we get 


X a,x" = (1 — x)*t} X SOx? = = (1 — xy! X crt tk) a 
n-0 





(8) 

Moreover, by multiplying the series 

l T 

= y X 
1 — Xx n=0 
by itself k + 1 times, we get the identity 

12(1-3*'! Y Ca "x", (9) 

n=0 


which holds in the same interval (— 1, 1). Multiplying both sides 
of (9) by A and then subtracting (8) term by term from the result- 
ing identity, we finally obtain 


ae 


A= È a= (l L C (A — yh?) x". 


8. Cf. the comment to Problem 3, p. 17. 


B Fichtenholz (2094) 
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The rest of the proof, with the use of (5), is the exact analogue 
of the proofs of Abel’s theorem (Theorem 1, p. 92) and Frobe- 
nius’ theorem (Theorem 1, p. 101). As a result, we conclude that 


lim Y ax"—A4. E 
x—51— n=0 
Remark. There exist divergent series which are summable by 
the Poisson-Abel method, but not by the generalized Cesàro 
method of any order. Thus the Poisson-Abel method is more 


powerful than the generalized Cesaro method of arbitrarily high 
order. 


PROBLEMS 


1. Prove formula (3). 
Hint. Use mathematical induction on n, starting from the 
easily verified formula 


+k -1)tk *(k— 
Caco. cr, 


2. Given any positive integer k, show that the series 


x _ 1} C C (10) 
is not summable by the generalized Cesaro method of order k, 
but is summable to 1/2**! by the generalized Cesàro method of 
order k + 1. 


Hint. It follows from (8) and (9) that 


L SOx" = 2a 


l = natkon 
-1"C 
doge » ( FC x 


(1 — xy! n=0 


h 


1 = CP**y27 


(1 — x2yet! x o 


where the convergence of the last series in the interval ( — 1, 1) is 
easily proved by using the Cauchy-Hadamard theorem (this 
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implies the convergence of the first series as well). Equating co- 
efficients of identical powers of x in the first and last series,? we 
pet 


Sin = Cr", Stns. = (m= 0,1,2,...). (11) 
Therefore 
cmtk 1 
: (k) : 
LC = ie CP aK” 


while 

lim y22,, = 0, 
so that (10) fails to be summable by the generalized Cesàro 
method of order k. On the other hand, it follows from (3), (4) 
and (11) that 


seth = Ci + CE + crt? Lee Ct = [o 
both for n = 2m and n = 2m + 1. Hence 


m+k+1 
: œ+) qi Ck+1 | 1] 
lim Yam = lim am+k+1 ^ — 4k«1^ 
ma ma k+1 2 





© k 
and similarly for y$. 


3. Prove that the series 
Y, (D (n + D*, 
n=0 


where k is any positive integer, is summable by the generalized 
Cesàro method of order k + 1. 
Hint. Expanding C; '* in powers of n + 1, we get the formula 


+k 
Cy 


"i T k)(n - k — Y): (n + 1) 


H 


a (n + 1t + of (n + 1)! o - + of (n D), 


9. Here we anticipate the legitimacy of this operation, to be proved in 
G.M. Fichtenholz, Functional Series, Sec. 6, Theorem 3. 
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involving certain numerical coefficients «{*’, where 
a CO = 1l Æ 0 
too kb A 
Writing similar formulas with k replaced by k — 1, k — 2, ..., 1, 
and then solving for (n + 1)*, we find that 
(n + 1)* = pec ntk + Bea CE 1 4e + BP ci"? 


where the 8 are again certain numerical coefficients. But then 
X (~1)"(n + D* = B? X (-1y Gz** + p? X CD Cit"? 


Tel pe » (-1y» C crt, 


Now use the preceding problem and Theorem 2, as well as the 
linearity of the given method of summation. 


4. By Hólder's method of generalized summation is meant 
repeated application of the method of arithmetic means. Thus, 
besides 


_ Ao + At a S Aot Art tA, 
3 eee ^ n41 PP 


as on p. 98, we have next 


1 _ % T 0 r _ Sy tay tees + OX 
ao = Xg, Ai = ———,..., & = ————— ... 
2 n+l 


with corresponding generalized sum 


E , 
lim æn, 
n- v 
then 
xo + ai Oy + Oy +: + a 
, ” 0 1 " 0 1 vee n 
ao = 60, & = ———,..., & = —————_ , e 


2 n+l 
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with corresponding generalized sum 


. ^" 
lim of, 


and so on. Sum the following series by Hólder's method: 
a)1—24-3—4-c-; b)1-3246-—10---. 


Ans. a) Twofold "averaging" gives 4; b) threefold “‘averag- 
ing" gives $. 

Comment. The regularity of Hólder's method and the relation 
between the various generalized sums can be found by using 
Corollary 2, p. 23. It can be shown that k-fold application of 
the method of arithmetic means is completely equivalent to the 
generalized Cesàro method of order k, i.e., every series summable 
by one method is summable to the same sum by the other 
method. 


20. The Methods of Borel and Euler 


1) Borel’s method. This method consists in forming the ex- 
pression 


sey AX, (1) 


involving the partial sums 
A, =Agta, +e" +4, 


of the given numerical series 


a 


È Qn = dg + Ay tta, e. (2) 


nz 
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Suppose the series in the right-hand side of (1) converges, at 
least for sufficiently large x, and suppose the expression 





approaches a finite limit A as x > + œ. Then the number A is 
called the generalized sum (in the sense of Borel) of the given 
series (2). 
THEOREM. Borel's method of summation is regular. 
Proof. Suppose the series (2) is convergent, with sum A. Then, 
for sufficiently large x, 
A-eyA XL sey AŽ 
n=0 n! 








where «, = A — A,n. The right-hand side is the sum of the two 
expressions 








(3) 


n=0 n! n=N+1 n! 


(here we use the same technique as in the proof of Abel's theo- 
rem, p. 92 and Frobenius’ theorem, p. 101). Given any e > 0, 
let N be so large that |x,| < £ for all n > N. Then the second of 
the expressions (3) is less than £in absolute value (independently 
of x), while the first expression, being the product of e~* and a 
polynomial, can be made less than « in absolute value by simply 
choosing x large enough. BM 

2) Euler’s method. It will be recalled from formula (7), p. 74 


that A?a, 


2»*1 





Ec»*a-Yc» (4) 


(Euler’s transformation). As shown in Sec. 13, if the series on the 
left converges, then the series on the right converges to the same 
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sum. However, the series on the right may converge to a finite 
sum A even if the series on the left diverges. The number A is 
then called the generalized sum (in the sense of Euler) of the series 
on the left. The regularity of this method of summation, known 
as Euler's method, is an immediate consequence of the italicized 
assertion. 

Starting from the series (4) without the factors of +1 and 
recalling formula (2), p. 71 for the pth differences, we see that 
the generalized sum in the sense of Euler of the series (2) is just 
' he ordinary sum (provided it exists) of the series 


y dg + Cla, + Cla, t --— + Cha, 


p=o Deptt 


Remark. This concludes our discussion of methods for sum- 
ming divergent series. We have presented enough material to 
give the reader some idea of the great variety of approaches to the 
problem. Note that we have always insisted that our methods of 
generalized summation be regular. Had space permitted, more 
could have been said about the relations between different meth- 
ods of summation. It may happen that two methods of summa- 
tion have overlapping "domains of applicability" (neither of 
which is contained in the other, and it may even turn out that two 
methods assign different "generalized sums" to the same diver- 
gent series. 


PROBLEMS 


1. Sum the series 
1—-1-41-1-41-124-- 


by Borel’s method. 
Ans. 


. € bet 1 
lim e~? ———— = — 
zo 2 2 
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2. Sum the following series by Euler's method: 
ajl—-l-c-l-lc-c-:; bl-2-4-3-4--: 
c)1—2+42?—23 4-5; dj 13— 27435 -444-. 
Hint. In each case, use formula (4). 

Ans. a)A — 34; b)4°a,=1,4!a,9=1,4"a, =0 if p>, 
A=4-4=4; 0) Am =1,A=$-$+4--=4 
d) 4?a, = 1, A'a = 7, A?a, = 12, A? ag = 6, Aao = 0 
if p»3,A-i-itW4-i1s-7-k 

3. Let 

go(x), px); ..., 9 (x), ... 


be a sequence of functions defined on a domain X, where X has 
a (finite or positively infinite) limit point œ. Given a numerical se- 
ries (2), with partial sums A, = dg + a, + --- + 4,, Construct 
the “functional series" 


2, Ann (X) = Aopo (x) + Aip, (X) to + Ap X) + =. 
(5) 


Suppose the series (5) converges, at least for x sufficiently near w, 
and suppose the sum of (5) approaches a finite limit A as x > w. 
Finally, let A be called the “generalized sum" of the series (2). 
This gives a very general method of summation, which is ob- 
viously linear. Prove that the method is also regular, provided 
the functions g,(x) satisfy the following three conditions: 


1) For every fixed n, 


lim g,(x) = 0; 


x>w 
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2) For x close enough to w (i.e., for |x — «| < óif c is finite 
or x >Aifw = +0), 


Y. Ie] € K = const; 
n=0 
3) 
lim Y, 9,(x) = 1. 
xao n0 


Hint. If A, > A asn > oo, then, given any £ > O,thereisan N 
so large that 


l4, — Al < x (6) 


for alln > N. It follows from the boundedness of the A, and the 
absolute convergence of the series 


À ex) 


that the series 
eo 
Y AnPa(x) 
n=0 
converges (at least for x close enough to w). Moreover, 


LAm = A= Y Ay Aes) Y 47 Ae) 


«(X o- j. 


and hence 


L (4, ~ A) 9, (x) 





Y AnPnlx) — A < 








X Ms ~ ADI + A |X eo) = 1 








The second term on the right is less than £ because of (6), while 
the first and third terms can each be made less than £ by choos- 
ing x close enough to w. 
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Comment. Clearly, there is another version of the foregoing 
which involves the numbers a, (the terms of the series) rather 
than the partial sums A,. 


4. Particularize the preceding problem to the case where X is 
the set of all nonnegative integers m, with limit point w = +œ. 

Hint. Instead of the sequence of functions (g,(x)), we now 
have an infinite rectangular matrix 





foo foi fo» * fom ‘* 
fio fia fiz ce fim ot 
fog t21 toa c fog c7 (7) 
fao lni fa? e. tam Ut 


(tam = Pa(m)), and the "generalized sum" of the series (2) be- 
comes 


lim (Aofom + Aitim + Aatom ro Antam on). 


ma 


The regularity conditions are now the following: 
1) For every fixed n, 


lim fam = 0; 


mow 


2) For sufficiently large m, 


a 
Y, |t.| € K = const; 


a 
Il 
o 


3) 
lim Y, tim = 1. 


m+a n=O 
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Comment. These ideas are essentially due to Toeplitz, who, 
however, considered the case where the matrix (7) reduces to an 
infinite triangular matrix. This special case is sufficient for most 
purposes. 


5. Show that the general method of summation of Problem 3 
contains the Poisson- Abel method and the Borel method as 
special cases. 

Ans. The Poisson-Abel method corresponds to 


g(x) = (1-97, X¥=(0,1), w=1, 


while the Borel method corresponds to 


x" 


n! 


p(X) -e7*—, X= (0, +0), w= +0 


(the regularity conditions are clearly satisfied in both cases). 
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